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A VALIDATION DESIGN FOR QUALITATIVE 
STUDIES OF PERSONALITY 


By LEE J. CRONBACH 


UNIV: 


‘HE METHODOLOGY of research 
w % in personality has lagged seriously 
behind the development of personality 
theory and diagnostic techniques. Per- 
sonality is today conceived in terms of 
structures rather than traits. There is 
an attempt to study the individual as a 
, rather than to isolate very smal 
elements for study. Behavior is 
sidered as an interaction of person and 
situation, rather than as a property of 
the person alone. 
The traditions of psychological “meas- 
’ are basically unadapted to a 
dynamic personality theory. At least at 
present, approaches such as correlation 
and factor analysis of traits can cope 
only with special cases within the broad 
domain of personality research. Neces- 
sarily, clinicians have disregarded meth- 
ods which are inadequate to their data. 
But the lack of suitable methods has 
sometimes led them to discard all at- 
tempts at validation, and this has 
brought suspicion upon findings which 
may well be sound. There have been 
some attempts to develop suitable re- 
search designs for organismic studies 
of personality, but they have not been 
very successful. The present paper pro- 


axrl ] 
wi A 


con- 


SITY 


ILLINOIS 


poses a method for more complete valid- 


ation of qualitative analyses of 


ality structure. 


person- 


PRESENT METHODS FOR VALIDATION 
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Validation is the procedur 
ing that a statement is true. One may 
need to validate a prediction of success 
description based on a te 
c. Complete assess 
ty must be qualitative. It may 
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the OSS assessment procedures [4, 
pp. 209-210]. The assessment staff com- 
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ments: 


The selection of men consists of two t 
arriving at diagnoses of the personalities of the 
subjects and making prognoses of their effec- 
tiveness in assignments. The basis for both of 
these judgments by the assessment staff is bet- 
ter revealed in the written reports on the can- 
didates than in the arrays of final grades that 
were assigned to them. An individual’s char- 
acteristic patterns of adjustment, his personal 
motivation and desires, his special liabilities 
and distinctive assets are poorly represented 
in numerical ratings [4, p. 435]. 


A prediction or analysis is validated 
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by comparing it with some other data 
accepted as a criterion. If assessment 
gives an organismic-situational pre- 
diction, covering the whole man in re- 
lation to various situations, it can be 
validated best by an organismic-situa- 
tional criterion. Many investigators 
have been discouraged by the problems 
of obtaining and treating organismic 
criteria, and have reluctantly retreated 
to a severely limited quantitative criteri- 
on. It is a violation of all personality 
theory to rate men on leadership, and 
use such ratings as a “true” picture of 
their performance. The rating is an ap- 
proximation to truth only when the 
situation in which the men act is virtual- 
ly uniform. A man’s effectiveness as a 
leader depends on the structure of the 
group he leads, the task they are set, 
the demands placed upon him by his 
superior, and a number of other factors. 
These elements are neither random nor 
unpredictable. But a rating on leader- 
ship in one situation may have little cor- 
respondence with leadership when the 
situation changes. The median intercor- 
relation of leadership ratings in the OSS 
situational tests was .41 [4, p. 521], and 
even so leadership was regarded as more 
generalized than other traits they 
studied. A striking example of the limi- 
tation of ratings for either prediction or 
criterion is the story of the man judged 
by the assessment staff as “high aver- 
age”; the man turned up in the criteri- 
on, however, as a neuropsychiatric casu- 
alty because he happened to be taken by 
Germans while disguised behind their 
lines and was subjected to extreme 
tortures [4, p. 452-3]. Present methods 
cannot make allowance for the situation, 
when such a case reduces the correlation 
between assessment and criterion. 

To be desired is a criterion which de- 
scribes how (not just how well) the man 
functioned in the situations where he 
operated. Two men might be rated 
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“high average” on emotional stability. 
But assessment might describe man A 
as “stable except under continued pres- 
sure for speed; in long periods of con- 
tinuous work of this type, he may be- 
come irritable and erratic.” Man B, on 
the other hand, might be analyzed as 
“able to maintain his morale and ef- 
fectiveness under any pressure and 
strain so long as his group seems to be 
making progress; he becomes disorgan- 
ized in a fouled-up organization, where 
patience and humor are required to wait 
out delays and confusions.” No matter 
how the criterion is obtained, it cannot 
do justice to the assessment unless it 
too is descriptive of both the man’s be- 
havior and the situation. It is not sur- 
prising that the OSS assessments corre- 
lated poorly with the final ratings of 
men sent to all parts of the world, to 
work on all sorts of jobs under all sorts 
of superiors. 

The OSS staff was able to obtain 
qualitative criterion descriptions of 36 
men. The final judgment from these 
data was that between 24 and 31 of the 
assessments were essentially correct, the 
remainder being incorrect or half cor- 
rect. This, contrasted to the poor vali- 
dation by ratings, supports the con- 
tention that a qualitative criterion is 
needed to bring out the full validity of 
the assessment. Of concern here is the 
method of treating the qualitative cri- 
terion. The OSS staff members studied 
the prediction and criterion, and rated 
them as to their agreement. Usually, two 
judges rated each set of data. This meth- 
od, though at times necessary, is open 
to severe criticism. (a) The wish of the 
judges that the predictions be true can- 
not be demonstrably controlled. (b) If 
the predictions are partly in error, the 
analysis does not show objectively which 
portions are wrong. (c) To a clinician 
versed in reading case analyses, the pre- 
diction and criterion might be consis- 
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tent; yet to a layman making use of the 
assessment, it might be incomprehensi- 
ble or misleading because of complex 
psychological language. 

The conventional method for treating 
qualitative data to overcome some of 
these objections is the blind-matching 
technique. The application of this meth- 
od to personality research was outlined 
by Vernon [3] and has been used ex- 
tensively especially in Rorschach work. 
A judge is given (say) four analyses 
and four criterion descriptions. He at- 
tempts to match these into the proper 
four sets. Statistical methods are avail- 
able for expressing the degree of agree- 
ment found. This method is not in- 
fluenced by bias, but it has limitations. 
(a) If an analysis is partly right and 
partly wrong, it may be matched with 
the criterion and the prediction will 
seem to be valid; the method does not 
show the degree of correctness of each 
prediction, nor the aspects of the pre- 
diction that are invalid. (b) Judges are 
likely to match or mismatch on small 
coincidences or even single words in the 
analysis. The judge may mismatch a 
very accurate prediction because just 
one sentence is contradicted by the cri- 
terion, or may match a very poor pre- 
diction with the criterion because one 
correct sentence gives him a clue. 

Evaluating a prediction requires more 
than a general estimate of its rightness 
or wrongness. For example, Henry used 
the TAT to study many aspects of 
personality: intelligence, relations with 
parents, emotionality, etc. He found that 
judges could match his portraits with 
descriptions based on life histories or 
other data [2]. But this successful 
matching might be due to correct 
analyses of intelligence alone. If the 
judge matched portraits on this factor, 
a chance relation could exist on the 
other elements of the description, yet we 
would have “proved” that the TAT gave 
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valid case descriptions. A statement that 
matching is 80 per cent accurate in no 
way establishes that 80 per cent of the 
statements made in the prediction agree 
with the criterion. Yet identifying 
strong and weak aspects of the pre- 
diction is precisely the way to improve 
interpretation of the tool. Henry was 
aware of this need, but lacked an ob- 
jective method for making this evalu- 
ation. 

There are many variants and develop- 
ments of the above methods, but all are 
open to the criticisms given. Some in- 
vestigators would retreat to correlating 
scores or the raw data themselves with 
the criterion, abandoning as worthless 
the qualitative synthesis made by the 
clinician. While psychology would be 
glad to do away with subjectivity, one 
cannot discard a process which produces 
truth no other method can yield. After 
it has been demonstrated that clinical 
synthesis of data is valid, it is time 
enough to gradually objectify the pro- 
cess of interpretation to do away with 
“intuition.” 


PROPOSED METHOD: OVERVIEW 


The method to be discussed here is a 
modification of blind matching. It re- 
tains the advantage of freedom from 
bias. It permits a qualitative assessment 
to be compared with another qualitative 
assessment or criterion. It indicates the 
validity of assessment for each single 
case. It indicates what aspects of per- 
sonality are validly analyzed and which 
are not. The procedure checks the 
semantic validity of assessment; if it is 
true but incomprehensible to those who 
will use it, it is adjudged to be unvalid- 
ated. The price of these advantages is a 
rather laborious design. And, as in all 
validation, one is limited by the weak- 
nesses of the criterion. 

The method is briefly as follows: 

1. The clinician makes his prediction 
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or description by whatever methods he 
intends to validate. 

2. <A suitable qualitative criterion is 
obtained. 

3. A triad of three cases is consider- 
ed. The prediction made about each case 
is broken into separate statements. A 
statement sheet is prepared which con- 
tains, in mixed order, one third of the 
statements about each case in the triad. 
Two other statement are also 
prepared, using up the remaining state- 
ments. 

4. A “competent” judge, similar to 
those who will use the predictions, is 
given one statement sheet and the cri- 
terion describing one of the three cases. 
He rates each statement as fitting or not 
fitting the criterion, or as doubtful. 
Knowing that only about one-third of 
the statements were made 
man described in the criterion, he must 
attempt to identify those statements. 

5. This process is continued until 
every statement-criterion pair has been 
rated by seven or more judges. A mini- 
mum of 63 


sheets 


about the 


judges is required to cover 
all combinations. A statistical summary 
is then made by a method to 


—— 
scribed. 


be de- 


In presenting the details of the meth- 
od, the writer will illustrate its appli- 
The 


method has been used successfully on 


cation to a study now in progress. 


nine cases in a preliminary stage of the 
study. Because the study is continuing, 
and because the preliminary trials were 
in many ways open to improvement, the 
report given here is not intended as a 
presentation of the study itself. The 
problem under consideration is to de- 
termine the relation of personality to 
the success of graduate students. The 
Rorschach test was given to students 
who had passed the preliminary exami- 
nations for the Ph.D. at the University 
of Chicago, Department of Education. 
The test was analyzed much as usual, 
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and a description about 500 words long 
was written which emphasized how the 
student would probably function in the 
problem-solving activities of his doctor- 
al research. After the student was well 
along in his research, his adviser who 
had supervised the work was asked to 
describe how he had performed in the 
research work. This was accomplished 
by a largely unstructured, open-question 
interview. (In further work, a more 
focussed interview will be used.) As 
judges, graduate students in psychology 

ducation in other universities were 
used; it was assumed that these people 
were sufficiently comparable to the 
faculty members who would normally 


make use of the predictions. 


DETAILED PROCEDURE 
tions are made by any process: 
objective, intuitive, 
tive, observational, etc. If judgment is 
» enter, one is then validating 
the iudgment of the interpreter, rather 


projec- 


than the data on which the prediction 
is based. While the qualitative assess- 
ment is normally written as a unit, it 


can only be validated in separate state- 


ments. This is a definite limitation of the 
d validation method, since an as- 
sessment portrait is more than the sum 
of the statements; the statements serve 
to modify each other. The following 
were taken from several 


pr DO 


a. s ‘ LS 


He is not capable of organizing ideas. He 


is strictly limited to examining detailed facts. 
He is not especially interested in synthesis 
I J ; 


of ideas into theories, nor does he lose himself 
in tiny detail. More nearly, he looks at the 
normal, everyday, practical situation instead 
of abstractions or petty subdivisions. 

He is strongly ambitious. His drive in work 
is less one of curiosity or of enjoyment than 
of the impression he is making. 

He has excellent control, and must be con- 
sidered overcontrolled by conventional stand- 
ards. He is far from a slapdash, spontaneous 


person. 
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He does much better as he becomes more 
familiar with a situation. 


About fifteen such statements were 
derived for every case. Most statements 
are complex, corresponding somewhat 
to Allport’s notion of the idiographic 
trait. Certainly no list of trait ratings 
could duplicate the information in a de- 
scriptive assessment, since hundreds of 
different traits are brought to light in 
different cases. The prediction for each 
case deals primarily with the complex 
traits which are salient in his behavior, 
rather than with a standardized list of 
defined traits. It should be made clear 
that the study is not predicting a gradu- 
ation-elimination criterion. This would 
be unsound, since fortuitous circum- 
stances make such prediction impos- 
sible. But one can predict that if this- 
or-that situation arises the student is 
less likely to finish his degree. Whether 
the student finishes depends largely up- 
on the research problem he undertakes 
and the direction he receives (apart 
from strictly financial and personal in- 
fluences). 


The adviser’s statement to be used as 
a criterion was usually about 500 words 
long. It was obtained by such nonleading 
questions as “Tell me about X” and 
“What sorts of difficulty have been most 
serious in his doctoral work?” A better 
criterion can probably be obtained by 
several precautions not used in the first 
trials. One would be to follow the open 
questioning with a list of areas or as- 
pects of behavior, eliciting specific com- 
ments on each one. A second would be 
to submit the transcript of the interview 
to the adviser for rereading and editing. 
It should be recognized that the criteri- 
on is not perfectly true. The adviser has 
watched the man closely, but he has a 
value system and a personal bias. Every- 
one would agree that the criterion state- 
ment reveals the adviser’s personality. 
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But the task of the graduate student is 
to satisfy the adviser’s criteria; the task 
of assessment is to predict how he will 
do that. An eventual use of the research 
might be to help advisers re-examine 
their bases for judgment; now it would 
be premature. A disturbing aspect of 
the study is that occasionally the ad- 
viser’s comment contains some elements 
which are demonstrably false. Luckily, 
these are relatively few. 

Next, cases are grouped in triads. The 
three cases compared might be chosen 
at random or might be grouped so that 
the cases are in some ways similar. It 
would be illegitimate to group cases de- 
liberately to get the greatest contrast 
within each triad. However, when the 
groups are deliberately made homogene- 
ous, the validity coefficients are reduced. 
The best plan for grouping is to make 
cases within a triad reasonably similar 
on significant externals, such as age, 
sex, and sometimes education. Then, in 
addition, the cases should be grouped so 
that each triad consists of men the 
predictor is attempting to distinguish 
among. In the OSS study, a properly 
severe validation would group three pro- 
pagandists, rather than grouping a pro- 
pagandist, an agent, and an office super- 
visor. In the graduate student study, the 
three triads were made up respectively 
of prospective educational psychologists, 
administrators, and curriculum-methods 
specialists. Usually, the criteria for all 
three men came from the same adviser 
or from advisers having similar view- 
points. 

An even better plan, but usually an 
impractical one, would be to place each 
case in several triads. 

A statement sheet is a mixture of 
statements made about the three men in 
the triad. The pattern is set up by means 
of random numbers. In the present 
study, statement sheet 2 consisted of 
statements A3, B13, C11, B7, C12, C3, 
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A4, B1, C10, A7, B15, B6, and A2 (i.e., 
the first statement in sheet 2 was the 
third statement in the description of 
person A). Two other statement sheets 
were also made up for triad ABC using 
the remaining statements. In the trial 
study, two statements were used in two 
statement sheets, and were rated differ- 
ently in the two places. To avoid such 
position effects, at least one other set of 
statement sheets should be made up for 
the triad, grouping the same statements 
in different combinations and different 
orders. One would therefore have six 
statement sheets for the triad. 
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The problem now is to arrange the 
material so that every statement is com- 
pared with every criterion by several 
judges. No judge receives more than one 
criterion in any triad, since this would 
lead to blind matching rather than the 
judgment desired. For any triad, there 
are nine possible ways of pairing state- 
ment sheet with criterion sheet: 1-A, 
1-B, 1-C, 2-A, ...3-C (with six state- 
ment sheets, there are eighteen pairs). 
In the present study, with nine cases in 
three triads, and only three statement 
sheets per triad, the materials received 
by judges were arranged as follows: 


Judge 1compared statement sheet 1 with criterion A 


” ” 9 


” 9 ” 


Judge 2 compared statement sheet 1 with criterion A 


” ? 9? 


9? %? 9? 


Judge 25 compared statement sheet 1 with criterion C 


9? 9 ” 


” 9 9 


4 ’? %? D 
4 ’? 99 G; 
4 9”? 93 EB 
7 9’? 9%? H; 
6 9’? 9? D 
I; and so on. 


9 9” 9? 





The pattern for the judges was 
worked out to achieve maximum ran- 
domization. 

Directions to the judge were as fol- 
lows: 


First read the criterion sheet. Fix in your 
mind firmly the portrait presented there. Then 
take the corresponding statement sheet, and 
judge each statement as follows: 


+ if you think the statement was probably 
made about the same person as the criterion 
sheet describes. 

0 if you think the statement definitely does 
not fit the person on the criterion sheet, and 
must have been made about one of the other 
two persons in the group. 

? if you cannot decide whether the statement 
was made about this person or one of the 
others. 


In any set of statements, roughly one-third 


were made about the person you are taking as 
criterion. On some statement sheets, however, 


the division of statements between the three 
persons was quite uneven. 

You may reread the criterion sheet as often 
as you wish. 


The uneven division of statements be- 
tween the three cases was planned to 
force an independent judgment of each 
statement, to prevent the judges from 
trying to find the four or five best-fit- 
ting statements in the list. 


It was expected that judges would 
use ? in the many cases where some as- 
pect of behavior predicted was not dis- 
cussed in the criterion. Instead, judges 
tended to use O where they had insuf- 
ficient data. With 107 judges rating one 
to three statement sheets, the dis- 


tribution of judgments was 1467 +; 
1692 O; 495 ?. 
Analysis of data. For every prediction 
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statement, one can count the number of 
times it was rated +, O, and? against 
each of the three criteria for its triad. 
The data for E6 may be taken as an ex- 
ample: 


Ratings received 


+ 0 ? 
I i 6 3 1 
I 4 7 2 
EER WF un cimitecnndeakeannaaaie 0 6 5 


E is the “true” criterion for the state- 
ment, and most judges did consider the 
statement as fitting that criterion. D and 
F are control criteria in this case; the 
majority of judges who had those cri- 
teria rated E6 as not fitting. This is 
evidence that E6 is a valid statement, 
and that it is not one of those over- 
general statements that seem to fit any 
person. To treat data statistically, a 
single “mark” was used to summarize 
the ratings of judges. When the number 
of judges marking the item + exceeded 
the number marking it O by two, a mark 
of + was assigned, signifying that the 
judges tended to rate the statement as 
“fitting.” If the number of zeros ex- 
ceeded the number of +’s by two, a sum- 
mary mark of O was assigned. Wher- 
ever the number of + and O ratings did 
not differ by two, a mark of ? was as- 
signed. With seven or more judges, this 
arbitrary scheme of tabulating appears 
quite successful. A greater number of 
judges, of course, increases the depend- 
ability of conclusions. Statement E6 was 
said to be rated + with criterion E, and 
O with D and F, the control criteria. 

A correction was found to be essential 
to avoid serious and misleading re- 
duction of validity estimates. A state- 
ment may well be true of all three 
men in a triad, and would be rated + 
with each criterion. This would make it 
seem overgeneral and nondiscrimina- 
ting, even though it is true. This should 
not be permitted to reduce the validity 
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coefficient, if the same prediction was 
actually made about all three men. Du- 
plicating statements were therefore 
identified. This process was done sub- 
jectively by the writer, although it 
would be possible to bring in other 
judges. Each statement made about man 
E, for example, was checked against the 
predictions for D and F. Wherever the 
prediction for E seemed logically to du- 
plicate a prediction made about D, the 
duplication was noted. An example is 
H5: “He tends not to see varied pos- 
sibilities in normal organized situa- 
tions.” Virtually the same prediction 
was made about G. This was therefore 
identified as a duplicated prediction, this 
judgment being made before the ratings 
of judges were tabulated. The summary 
for H5 was: with H, +; with G, +, with 
I, O. But since the same prediction had 
been made (in other words) for G, G 
was not used as a control criterion for 

The next problem is to estimate the 
validity of predictions made about a 
single case, say C. First one determines 
how well the predictions for C fitted cri- 
terion C, and compares this with how 
well predictions for A and B fit criteri- 
on C. This in essence asks whether the 
predictions made about C fit the criteri- 
on better than other statements that 
might be made at random. The data are 
as follows: 


Number of 
statements 


rated 
0 ? 
Made about C ..... sal 6 5 1 
Made about A or B aes 8 10 4 
Made about A or B, after re- 
moving those which duplicate 
predictions for C .................. 4 10 1 


Ratings of ? are disregarded, since there 
is no basis for considering such state- 
ments valid or invalid. The four-cell 
table below contains the essential data: 
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Rated Rated 
+ 0 
Predictions for C ........................ 6 5 
Control statements ...................... 4 10 


Chi-square, computed from this table, 
is .81 (P < .50).' It has therefore not 
been demonstrated that predictions for 
C fit the criterion better than chance. 
The chi-square estimate of significance 
may be converted to a phi coefficient 
showing the size of the relationship. To 
allow for the assumption that the plus- 
zero dichotomy represents a continuous 
distribution, the correct formula is [2, 
pp. 93, 443]: 


=125,/7 
¢=1. of 


For case C, with 25 statements rated, ¢ 
= .33. 

Such estimates were made for the 
nine cases, and in every case save one 
there was agreement between prediction 
and criterion better than between con- 
trol predictions and criterion. Only one 
of the chi-squares, however, exceeded 
the 20 per cent level of significance. 
These estimates for a single case, how- 
ever, do not represent the best test of 
the hypothesis that the predictions are 
valid. That test must be made on the 
combined data. The fact that positive 
correspondence was shown in eight out 
of nine cases implies that the null 
hypothesis may be rejected (P < .02). 
Another way of testing significance is 
to combine all data as follows: 


Rated Rated 
+ 0 
Statements compared with 
WEEE” CEERRTIOR o..cceccsneccsccccseees 47 42 
Statements compared with 
control criterion, 
duplications eliminated .......... 51 88 





1Chi-square is an inaccurate statistic when 


N < 50, or when the theoretical frequency is 
less than 5 in any cell. Yates’ correction has 
been applied in such calculations of chi-square 
as one means of reducing error. 
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For this table, chi-square is 5.75 (P < 
.02), and ¢ is .20. The latter is the best 
overall estimate of the degree of cor- 
respondence of predictions and criteria. 
The coefficients for individual cases 
ranged from — .05 to .53. The overall 
significance test may also be made by 
combining chi-squares from the indi- 
vidual cases. 

So far, the method of validation has 
expressed the degree of fit between cri- 
terion and prediction and the signifi- 
cance of the fit. One can conclude that 
there is some correspondence, but far 
too low to be relied upon for selection. 
Study of the data indicates several ways 
in which the validity of predictions can 
be raised in further work, foremost of 
which is improvement of the criterion. 

The validation method also permits 
study of types of predictions separately. 
To do this, statements dealing with a 
particular aspect of behavior are sorted 
out. One such group deals with the sub- 
ject’s accuracy of thinking, tendency to 
refine ideas, and demands on himself for 
precision. The soundness of these state- 
ments is indicated by whether they 
agree better with the “true” criterion 
than with the control criterion, dupli- 
cations being eliminated. There were 21 
statements in the “accuracy” group, 
rated as follows: 


+ 0 ? 
When compared with criterion 
for person about whom pre- 
diction was made .................. 12 8 1 
When compared with other two 
criteria in the triad (dupli- 
cations eliminated) ................ 10 16 4 


As before, the ? ratings are ignored and 
the other ratings are used to determine 
7 and ¢ . For this table, z* is 1.36 and 
¢ is .27. 

Such an analysis was made for a 
number of groupings of the predictions, 
leading to results shown in part in Table 
I. 


























A DESIGN FOR STUDIES OF PERSONALITY 


TABLE I 
VALIDITY OF STATEMENTS BY TYPES 











Rated + with 

Aspect Number of true criterion 

of behavior statements Number Per cent x2 ri) 
Originality 10 6 60 3.84 63 
Accuracy 21 12 57 1.86 27 
Approach 22 14 64 1.04 26 
Social Relations 15 5 33 -04 ll 
Drive 18 6 83 -00 07 
Persistence 6 1 16 -00(—)-—.19 
Emotional control 12 1 5 1.51(—)-—.35 





Such information shows what aspects 
of behavior are being accurately pre- 
dicted, and which are being predicted 
erroneously. A low validity coefficient 
for a category implies that the 
Rorschach does not reveal that aspect 
dependably, that the interpreter is in 
error, or that the criterion is inadequate 
or erroneous in that area. Identification 
of the areas where a technique is likely 
to be erroneous is highly important. 


CONCLUSIONS 


The method described in this paper 
has been applied to a small study, and 
was found to be practicable. It yielded 
the types of objective analysis necessary 
for a thorough validation of a qualita- 
tive assessment of personality, and may 
be recommended for further studies. 

The advantages of the method may be 
summarized as follows: 


1. Neither the bias of the investiga- 
tor nor of the judges influences the esti- 
mate of validity. 

2. The estimate of validity, although 
using a qualitative criterion, yields a 
test of statistical significance and a co- 
efficient like conventional validity co- 
efficients. 

3. Qualitative criteria are more mean- 
ingful and more truthful than ratings 
or other quantitative criteria. 

4. The method identifies objectively 
the accurate and inaccurate aspects of 
the prediction. 

5. The method permits one to identi- 
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fy the types of cases for whom predic- 
tion is relatively accurate or inaccu- 
rate. 

The disadvantage of the method is 
that the design is laborious, and the 
services of a large number of judges 
must be enlisted. Since such a large 
group of judges cannot be hand-picked, 
there is some danger of careless judging 
which will reduce validity. The difficulty 
of obtaining adequate qualitative cri- 
teria must be recognized, but this prob- 
lem is not specific to this validation de- 
sign. The present method is not ideal, 
since it does not treat the prediction as 
a whole; but blind matching, which 
does treat the prediction as a whole, 
gives little or no information about the 
validity of the parts. 

Validation research should hold the 
spotlight in the field of personality for 
the next several years. In the past two 
decades, attention has been given princi- 
pally to developing a workable tentative 
theory of personality and inventing 
promising diagnostic methods. Until one 
has materials worth validating, valid- 
ation research must hold a secondary 
place. We now have projective tech- 
niques, situational tests, and numerous 
other new tools which purport to de- 
scribe personality; there lies ahead a 
large chore of validation to define the 
limits of dependability of each tech- 
nique; There must be methods of valid- 
ation capable of throwing out the super- 
ficially valid diagnoses that are so 
general they seem to fit any case, and 
the confusing pseudo-explanations that 
describe the person in technical jargon 
which conveys no real meaning. The 
methods must help to refine the tech- 
niques, rather than merely giving a 
stamp of complete approval to certain 
techniques and rejecting others in toto. 
It is no accident that the most promis- 
ing methods for studying personality 
have turned out to be the most complex 
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ones. It seems inevitable that appropri- 
ate research designs will be equally com- 
plex. 
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SOME CORRELATES OF THE GROUP RORSCHACH 
AND THE SCHIZOPHRENIA SCALE OF THE 
GROUP MMPI AMONG TWO GROUPS OF 
“NORMAL” COLLEGE STUDENTS 


By W. D. ALTUS 


UNIVERSITY OF CALIFORNIA, SANTA BARBARA COLLEGE 


NE OF the needs of the clinical 
psychologist is the validation of 

his psychometric devices, both project- 
ive and structured, against appropriate 
criteria. Still another almost equally 
pressing problem is that of the intercor- 
relation among the tests he now uses for 
differentially diagnostic purposes. The 
design of the present study is that of in- 
vestigating possible correlates between 
the Schizophrenia scale of the Min- 
nesota Multiphasic Personality Inven- 
tory (hereafter referred to as the 
MMPI) and the Rorschach Ink Blot 
Test. Schizophrenics furnish nearly one- 
half of the resident population of mental 
hospitals [4], and any means of making 
more certain the diagnosis of this dis- 
order by the combined use of a struc- 
tured and a projective technique would 
be of value. The validity of either test 
for diagnosing putative schizophrenia is 
not, however, within the scope of this 
paper. Only such possible linkages be- 
tween the two tests as may be found 
within the so-called “normal” range will 
be investigated. The assumption is that 
such linkages as may be uncovered by 
using “normal” groups would not be 
changed but would rather be maximized 
if psychotic groups were included to in- 
crease the range of tested maladjust- 
ment. Whether such an assumption is 
completely tenable is, of course, not 
known; if, however, schizophrenia is a 
continuous variable and if the Sc scale 


of the MMPI is at least a partial meas- 
ure of schizophrenia, then such an as- 
sumption seems worthy of a modicum 
of confidence. 

Although in clinical practice the 
Rorschach and the MMPI are usually 
administered individually, both tests 
now exist in group form so that it is pos- 
sible to employ them in mass surveying 
of all those who are literate in English. 
How much either test loses in validity, 
in the group as opposed to the individual 
administration, is not completely known. 
Wiener’s study [8] of the group and in- 
dividual administration of the MMPI 
indicates that little is probably lost in 
validity for that instrument. That sig- 
nificant insights into the factors of 
academic motivation and of adjustment 
can be obtained through the use of the 
group Rorschach has been statistically 
proved by Munroe [5] in her research 
at Sarah Lawrence College. 

At the beginning of the summer ses- 
sion of 1947, 100 students of elementary 
psychology at Santa Barbara College 
were given the group form of the 
MMPI. Also in the first week of the 
session the group form of the Rorschach 
was administered according to the 
directions standardized by Munroe [5]. 
The Rorschach was administered a sec- 
ond time four weeks subsequent to the 
first testing in order to obtain a reli- 
ability coefficient for those items of 
which use was made in the present re- 
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search. Seventy-five aspects or “items” 
from the Rorschach protocols were 
quantified and entered on individual 
cards. The scoring employed was basi- 
cally that of Beck [1], although Klopf- 
er’s FM and m [3] were separately 
scored for validation studies. The cards 
for those 25 students who earned the 
highest standard scores on the Schizo- 
phrenia scale of the MMPI were with- 
drawn for study, as were the cards for 
those 25 students who earned the lowest 
standard scores on the Sc scale. It was 
then possible to tabulate the responses 
of the two sets of cards by the usual 
method of item validation in testing, 
that of interquartile analysis. 


Among the 75 aspects of the group 
Rorschach protocols which had been 
quantified, ten items were selected 
which appeared, through interquartile 
analysis, to have the greatest degree of 
association with the Schizophrenia 
scale. Subsequently, the 100 cards con- 
taining the group Rorschach data were 
rescored on the basis of these ten points, 
thus making it possible to compute a 
Pearson product-moment coefficient of 
correlation between these ten points and 
the Se scale. The 7 proved to be .31, 
which, although “low,” is significant at 
the .01 level for an N of 100. When the 
test-retest reliability for the ten items 
was computed through recourse to the 
second administration of the Rorschach, 
the Pearsonian r was found to be .55. 
One of the reasons for the relatively low 
association between the two tests was 
thus made clear: It may be inferred 
from the Manual for the MMPI [2] that 
the reliability of the Sc scale is probably 
between .71 and .83. With two tests 
which have reliabilities of .55 and some- 
where between .71 and .83, it is evident 
that the maximum intercorrelation ob- 
tainable, short of the intervention of 
chance factors, would be in the neigh- 
borhood of .50. In relation to the limits 
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imposed by the relatively low reliabili- 
ties of the two variables, an intercor- 
relation of .31 does not seem so “low” 
as a first glance might make it appear. 


A second group of 41 college students 
was next given the MMPI and the 
Rorschach in order to determine wheth- 
er the linkages found to obtain for the 
first group would “hoid.” Only the first 
nine of the ten Rorschach “items” were 
employed for calculating the new validi- 
ty coefficient since the research com- 
pleted with the group of 100 (cf. Table 
I) had shown the inclusion of the tenth 
item (“vague” wholes) must have 
arisen from a statistical artifact in the 
original interquartile item analysis. For 
the new sample of college students, the 
Pearson product-moment coefficient be- 
tween the nine Rorschach “items” and 
the Sc scale of the MMPI proved to be 
Al, a coefficient which is not only sig- 
nificant at the .01 level but which is also 
.10 higher than the comparable r ob- 
tained from the first group of 100 cases 
studied. It would seem apparent, there- 
fore, that whatever the Sc scale of the 
MMPI is measuring, the Rorschach 
“items” (vague wholes not included) 
are measuring to an appreciable degree 
also. It must be re-iterated that the r of 
.41 between these two variables has to 


TABLE I 
TETRACHORIC VALIDITY COEFFICIENTS FOR CER- 
TAIN GROUP RORSCHACH “ITEMS” IN THEIR 
ASSOCIATION WITH THE Sc SCALE OF 
THE MMPI For Two Groups or 
COLLEGE STUDENTS 





Fi (first te (second 





Rorschach group) group) 
“Item” (N=100) (Ne 41) 
“TL. Dd%, 10 or more .....00 iit oa 25 pay 
>. SO a 45 
S. Gpace, S OP WTO ccccecccecccccccecrcene. 06 383 
ey. See ee 34 
i eee 0 Ot Oe 39 37 
me Se Oe DE, BOP bein - 58 .02 
> Oh, 2 OF: icteric 8 .82 
8. Color Sum, 2.5 or more .................. .17 41 
9. Total responses/number of content 

categories, 3.0 or higher ................ 33 27 
10. No “vague” wholes ......................... .00 —.31 























THE RORSCHACH AND THE SCHIZOPHRENIC SCALE OF THE MMPI 


be interpreted in terms of the putative 
maximum coefficient obtainable of .50; 
for that reason alone, an r of .41 must 
be considered as “high.” 

The individual “items” derived from 
interquartile analysis of the quantified 
Rorschach protocols are presented in 
Table I with two validity coefficients, 
both tetrachoric. To those who have 
used the Rorschach in a clinical setting, 
many of the aspects of the Ink Blot Test 
found in this table will not seem sur- 
prising. For instance, the first “item,” 
Dd per cent of ten or more, fits in with 
the description given of it long ago by 
Rorschach himself [7], who said that in 
the normal range a preoccupation with 
small detail indicated a grumbling, com- 
pulsive sort of person and that it was 
frequently found among certain types of 
schizophrenics, particularly those he 
called “scattered.” More recently, Rap- 
aport [6] has shown quantitatively that 
Dd were most often found in that group 
which he called “overideational” pre- 
schizophrenics. Clinically, then, a high 
percentage of small detail projections in 
the Rorschach has been known for a 
long time to be a malignant sign, often 
associated with schizophrenia. The pres- 
ent study merely adds a number to the 
small detail tendency in its association 
with the Sc scale of the MMPI. 

The three most valid items in the 
group Rorschach — valid, that is, in 
terms of the Sc scale criterion — are 
4, 5, and 9. The scoring of “populars” 
was that developed by Beck [1], but the 
validity of the popular scoring, contrary 
to what Beck himself believes, appears 
here to be contingent upon a ratio, the 
percentage of popular responses in the 
total record, rather than upon the ab- 
solute number which he believes to be 
more desirable. It must not, of course, 
be forgotten that he was thinking of the 
psychotic group as opposed to the nor- 
mal, instead of differentiating among 
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“normals” found in college. The fifth 
Rorschach “item,” FM four or more, is 
derivative from Klopfer’s system. It 
would appear from the present study 
that the Beck system of scoring loses 
something in not scoring animal move- 
ment with separate symbols as does 
Klopfer. The recognition by Klopfer 
[3] that animal movement in excess is 
an unfavorable sign would appear to be 
a quite valid clinical insight if the pres- 
ent data are to be trusted. Finally, the 
ninth “item,” which is a ratio revealing 
the paucity of content categories when 
related to the total number of responses, 
seems to have some fair share of validi- 
ty as an indicator of maladjustment. 
This ratio, R/C.C., is not in current use, 
so far as the writer knows, but it would 
seem worthy of further research, es- 
pecially if that research were conducted 
in a clinical setting, to corroborate or 
disprove the validity which it shows in 
Table I. 

It is felt by the writer that the quan- 
titative techniques employed in the pres- 
ent research could be used in still other 
studies which might attempt by count- 
ing to show what “signs” in a project- 
ive technique such as the Rorschach are 
associated with certain quantified, ex- 
ternal criteria. If a number of sets of 
such “signs” could be proved by repeat- 
ed experiments to have definite and 
statistically significant linkages with 
clinically significant criteria, then a 
great burden would be removed from the 
back of that hypothetical companion of 
every practising clinical psychologist, 
namely, “insight.” Certainly the signifi- 
cant validity coefficients reported in the 
present research, conducted among a 
“normal” college student population, in- 
dicate that when the range of malad- 
justment was extended to include psy- 
chotics even higher degrees of validity 
should be found. 
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M.M.P.I. CORRELATES OF CERTAIN MOVEMENT RE- 
SPONSES IN THE GROUP RORSCHACHS OF 
TWO COLLEGE SAMPLES 


By GRACE M. THOMPSON 


UNIVERSITY OF CALIFORNIA, BERKELEY 


HE VISUALIZATION of move- 

ment in the Rorschach cards is 
generally considered to be one of the 
most psychologically significant of the 
various types of responses to the test. 
Rorschach [6] presented a general in- 
terpretation of the determinant of hu- 
man movement or M which has been ac- 
cepted to some degree by virtually all 
later investigators: 


This component of intelligence can be noth- 
ing other than the ability to create new, in- 
dividual productions, the capacity for “inner 
creation.” In its finest development we call 
this artistic inspiration, religious experience, 
etc. Kinaesthesias must, therefore, be some 
sort of instrument for “inner creation” and 
for the ability to show introversion. 


M theoretically represents, then, a 
type of fantasy activity often of a high- 
ly individual sort, dependent upon both 
intellectual and emotional or personality 
factors for its appearance in a record. 
The saturation of intelligence in M re- 
sponses is seldom disputed, although 
there are certain qualifications. Bochner 
and Halpern [3] state that: 


A relatively good level of intelligence is re- 
quired for its production. However the con- 
verse of this is not necessarily true; good or 
even superior intelligence need not express it- 
self in M answers. 


This latter fact was brought out rather 
forcefully in an investigation previously 
reported by the writer [7] on the 
Rorschach records of 128 college stu- 
dents, which included a correlation be- 


tween the raw number of M in a stu- 
dent’s protocol and his verbal aptitude’ ; 
a definite curvilinear relationship was 
found to exist, with a clustering of cases 
in the quadrant representing high in- 
telligence and few M, as well as the 
quadrant of the scattergram represent- 
ing high intelligence and many M, but 
almost no cases in the quadrant repre- 
senting the lower half of the intelligence 
continuum and many M. The eta be- 
tween M and aptitude was found to be 
.54, denoting a rather marked relation- 
ship, especially in view of the attenu- 
ated range of aptitude represented by 
the selected college sample. It would be 
reasonable to assume that the saturation 
of intelligence in M might show up even 
more clearly in an unselected popu- 
lation. 

While accepting the intellectual load- 
ing of such M responses, the present 
study was intended to investigate an- 
other aspect of the same factor: the re- 
lationship between certain types of 
movement responses in the Rorschach 
and maladjustment, the criterion for 
maladjustment in this case being the 
Minnesota Multiphasic Personality In- 
ventory, The two types of movement re- 
sponses chosen for investigation were, 
first, human movement (M) visualized 
in small detail blot areas (Dd); and 
secondly, animal movement responses 
(FM) in excess of three. 


1As given by the Measure of Verbal Apti- 
tude, by W. D. Altus, 1944, unpublished. 
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Although it is admittedly difficult to 
isolate any of the single Rorschach items 
and to attempt to determine their sig- 
nificance out of the context of the full 
protocol, it was nevertheless felt that 
certain general trends might appear 
which would serve to clarify to some ex- 
tent the present conception of the inter- 
pretation of these two factors. 

The findings te be reported are based 
on a group of 100 college students de- 
scribed by Altus [1]. The reader is re- 
ferred to this article for a more com- 
plete description of the administration 
and scoring of the group forms of the 
Rorschach and the MMPI on which this 
study is based. 

In investigation of the first factor, 
human movement responses visualized 
in small details (M in Dd) it was found 
that of the 100 students, there were 20 
with records containing such responses 
and 80 without. Test-retest reliability 
for this single item yielded an r of .65. 
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Fic. 1. MMPI subscale scores of the group 
with M in Dd and the group without such M. 


The mean scores for both groups, 
those with M in Dd and those without, 
were then computed for all subscales on 
the MMPI. Although none of the dif- 
ferences between the two groups yielded 
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a t significant at the 1 per cent level, 
five scales showed ?’s around 1.5 or 
greater, with a range from .10 on the 
Paranoia Scale to 1.80 on Hysteria. 
More interesting and probably just as 
important is the fact that in all scales 
without exception the M in Dd group 
showed a relatively greater general mal- 
adjustment as indicated by consistently 
higher scores on the Minnesota. Figure 
1 shows this fact clearly. 

In order to isolate the items best 
characterizing the group showing the 
deviant M factor, each item of the 
MMPI was analyzed in terms of the 
“ves” answers given by the 20 students 
with M in Dd, and again in terms of 
the “yes” answers given by the remain- 
ing 80 students. The expected ratio of 


TABLE I 
ITEMs SHOWING MARKED DEVIATION FROM EX- 
PECTED RESPONSE IN THE RORSCHACH PRO- 
TOCOLS CHARACTERISTIC OF THE M IN 
Dp GROUP IN BOTH COLLEGE 
SAMPLEs (N = 141) 





Even when I am with people I feel lonely 
much of the time. 

At parties I am more likely to sit by myself 
or with just one other person than to 
join in with the crowd. 

I sometimes find it hard to stick up for my 
rights because I am so reserved. 

I am often afraid that I am going to blush. 

I have often been frightened in the middle 
of the night. 

I dream frequently. 

I like tall women. 





*I resent having anyone take me in so cleverly 
that I have had to admit that it was one 
on me. 

*I am often so annoyed when someone tries to 
get ahead of me in a line of people that 
I speak to him about it. 

*I have strong political opinions. 

*I enjoy the excitement of a crowd. 

*Christ performed miracles such as changing 
water into wine. 

*I would like to hunt lions in Africa. 

*At periods my mind seems to work more slow- 
ly than usual. 





*Items answered “False”’ 
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“yes” answers for each question should 
then have been in the form 20:80, or 
1:4, any item showing a marked devia- 
tion from this expected ratio was re- 
tained as possibly characteristic of the 
deviant group. 

The significance of the retained items 
was only considered tentatively, how- 
ever, since it was likely that at least 
some of the items may have been unique 
to the particular group of 100 students 
in question. Thus MMPI and group 
Rorschach records were obtained for a 
second sample of college students, 41 
in number, and the same process of 
item analysis followed in order to deter- 
mine which of the items previously se- 
lected retained their validity with the 
second group as well. The items from 
the MMPI which were effective in dis- 
tinguishing the records of the M in Dd 
group are shown in Table I. 


It will be noted that although several 
of the items defy easy classification, the 
majority my be categorized rather ade- 
quately into distinct groups. The most 
evident rubric is that of social with- 
drawal and introversiveness, accompa- 
nied by several items characteristic of 
a submissive nature. Lonely, reserved, 
submissive, and passive: these adject- 
ives seem applicable to the general tone 
of the distinguishing items. A certain 
amount of anxiety is suggested in the 
frequent fright in the middle of the 
night, the frequent dreaming, and the 
fear of blushing; although this category 
is not so marked as the former. 

The second type of movement re- 
sponse selected for investigation was the 
factor, animal movement responses 
(FM) exceeding three. As said previ- 
ously, it is difficult to isolate a single 
Rorschach factor for study, since the re- 
lationship between the various factors 
is often as important as or more im- 
portant than their significance separate- 
ly. However, the conventional Rorschach 
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interpretation usually designates an ex- 
cess of animal movement as undesirable, 
and since the average number of human 
movement responses for the college 
group in question was slightly less than 
four, it would seem reasonable if only 
on theoretical grounds that excess of 
this number might be undesirable on the 
whole. Further, it was found by Altus 
[1] that the most significant associ- 
ation with the Schizophrenic Scale of 
the MMPI was found by setting the 
breaking-point at four. 


Thus the hundred protocols were 
again divided into two groups, this time 
according to those with evidence of four 
or more animal movement responses and 
those with only zero to three such re- 
sponses. Thirty-four records were found 
in the former category and 66 in the 
latter, a ratio of approximately 1:2. 
Test-retest reliability for the single item 
gave an r of .67. 

The same procedure was followed 
here that had been followed for the M 
in Dd group: that is, means for each of 
the separate subscales on the Minnesota 
were computed for the 34 students with 
an excess of FM and again for the re- 
mainder of the group, and differences 
and t-scores calculated. The general re- 
sults are much the same as they were in 
the case of the M in Dd group, showing 
the deviant FM group slightly more 
maladjusted on all the scales but one. 
The t’s ranged from .16 on the K scale 
to 1.97 on the Schizophrenia scale. Fig- 
ure 2 compares the two groups. It will 
be noted again that Hysteria and Schizo- 
phrenia showed the greatest differences, 
this time with Psychopathic Deviate, 
Psychasthenia and Hypomania scales al- 
so comparatively marked. 

Items characteristic of the group with 
many FM responses were then selected 
in the manner previously described for 
the other deviant group, the significant 
items again cross-validated by the sec- 
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Fic. 2. MMPI subscale scores of the group 
with excess FM and the group with 0-3 FM. 


ond group of records. These items are 
shown in Table II. Klopfer and Kelley 
[5] state that: 


Invariably, where there is reason from other 
sources to believe that a subject is emotionally 
infantile, living on a level of instinctive promp- 
ting below his chronological age, the Rorschach 
record of such a subject shows a predominance 
of FM over M. 


Such a description seems to fit many, 
though certainly not all, of the items 
selected which distinguish the group 
from the rest of the records. It will be 
noted, in attempting to categorize the 
items of Table II, that several fit in 
rather well with the 3-point difference 
between the two groups on the Psycho- 
pathic Deviate Scale, a sort of irre- 
sponsibility for the socially acceptable 
reaction. Several of the items reflect an 
impetuous or even belligerent attitude, 
again implying social immaturity or 
tactlessness. Interestingly, three items 
concern an inability to concentrate. Per- 
haps the adjectives most applicable to 
the FM group, then, would be: distract- 
ible, aggressive and irresponsible; ad- 
mittedly these represent only a crude 
attempt at classification. 
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SUMMARY 


The group Rorschach and the group 
Minnesota Multiphasic Personality In- 
ventory were administered to two 
groups of college students. Two types 
of Rorschach movement responses were 
analyzed to determine their relationship 
with maladjustment as measured by the 
MMPI: human movement visualized in 
small detail blot areas and animal move- 
ment responses in excess of three. Both 
deviant movement responses were 
shown to be lined with maladjustment, 


TABLE II 
ITEMS SHOWING MARKED DEVIATION FROM EX- 
PECTED RESPONSE IN THE RORSCHACH PRO- 
TOCOLS CHARACTERISTIC OF THE FM 
Four OR MORE GROUP IN BOTH 
COLLEGE SAMPLES 
(N = 141) 





At times I feel like picking a fist fight with 
someone. 

I have at times stood in the way of people who 
were trying to do something, not because 
it amounted to much but because of the 
principle of the thing. 

I do not blame a person for taking advantage 
of someone who lays himself open to it. 

At times I have been so entertained by the 
cleverness of a crook that I have hoped 
he would get by with it. 





I am often so annoyed when someone tries to 
get ahead of me in a line of people that 
I speak to him about it. 

At times I have enjoyed being hurt by some- 
one I loved. 

I feel that I have been punished without a 
cause. 


There seems to be a fullness in my head or 
nose most of the time. 

I cannot understand what I read as well as 
I used to. 

I cannot keep my mind on one thing. 

I have more trouble concentrating than oth- 
ers seem to have. 

I am afraid of finding myself in a closet or 
small closed place. 


*I do not try to correct people who express an 
ignorant belief. 


“Item answered “‘False’’ 




















MMPI CORRELATES OF RORSCHACH MOVEMENT RESPONSES 


the former of a lonely rather withdrawn 
variety, the latter irresponsible, aggres- 
sive and distractible. 

In conclusions, it should be said that 
the validation of one personality test 
against another can at best yield only 
tentative and indirect inferences about 
actual behavior. It remains the task of 
clinical psychometrics to make use of a 
broader and more reliable behavioral 
criterion in the investigation of move- 
ment responses in the Rorschach. 
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HE PRESENT investigation is an 
ti analysis of some of the data col- 
lected by Altus [1] as a result of ad- 
ministering the Group Rorschach and 
the group MMPI to one hundred college 
students. Basically, this paper has to do 
with the interpretation of Rorschach 
color responses in terms of the more ob- 
jective MMPI. 

The following Rorschach scoring cri- 
tera were selected for analysis: (a) 
number of FC, (b) FC: CF + C ratio, 
(c) number of CF, and (d) sum C, or 
the total of the color responses in the 
record. The test-retest reliability of the 
first two of these proved to be of such 
low order that they will be only briefly 
considered. The reliability 7’s are: (a) 
FC, + 29; (b) FC: CF +C ,ratio, 
+ .28; (c) CF, + .61; (d) sumC, + .66. 
The first three of the reliability coeffi- 
cients are tetrachoric; the final one for 
sum C is Pearsonian. 

The items on the MMPI were ex- 
amined in relation to the number of FC 
responses. The division was made in 
terms of two or more FC (N = 53) and 
below two FC (N = 47). An analy- 
sis of the items which were selected 
as discriminative indicates that a 
greater number of FC responses (two or 
more) is generally correlated with good 
adjustment, as there is a noticeable 
paucity of responses which could be clas- 
sified in the psychotic category. This 
“good” adjustment, however, seems to 
be penalized by an apparent constric- 
tion; that is, there appears to be an 


overcaution in social standards, a self- 
estimation or self-criticism which is 
sometimes deprecating, and frequent in- 
decision. 

In examining the relationship between 
the FC: CF + C ratio and the items of 
the MMPI, the division was made in 
terms of those records having a ratio 
of 1.5 and higher and those with ratio 
below 1.5. For the group who had the 
higher ratio, that is, for those with 
proportionately higher FC scores, it ap- 
pears that there was more interest in 
“the principle of the thing” and also 
more tendency to “try to correct people 
who express an ignorant belief.” The 
higher FC tendency appears also to be 
linked up with a greater degree of social 
consciousness, and some of the discrimi- 
native items tend to indicate that this 
concern over social relations may border 
on anxiety. 

These findings are only tentative, 
however, because of the low order test- 
retest v’s for these two scoring deter- 
minants. The results of the analysis of 
CF and sum C relationships may be in- 
terpreted with greater confidence. It 
may be said in passing that Thompson 
[5] found no correlation between sum 
C and CF score with college aptitude 
as measured by the Ohio State Psy- 
chological but found that the C sum is 
negatively correlated with college 
grades — those having higher C sums 
make poorer grades. 

In investigating the relationship be- 
tween higher CF and sum C scores and 
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the MMPI two methods were used: (1) 
an appraisal of the differences between 
means on the MMPI subscales, and (2) 
item analyses of the MMPI items. In 
appraising the differences of mean 
scores on the MMPI subscales in re- 
lation to the CF scoring category, the 
break was in terms of two or more CF; 
the N was 43 for CF two-or-more group, 
and 57 for one-or-less CF. The vali- 
dating scales and clinical subscales were 
tabulated for these two groups with the 
finding that only in the Hypochondri- 
asis scale was there a difference which 
approached significance. The Hypo- 
chondriasis mean score for those with 
two CF or more was 3.60 T-score points 
above those with one or less CF. Greater 
differences, however, were found in the 
mean scores on the MMPI in relation to 
the C sum. Although only one difference 
is significant at the five per cent level 
(there is a difference of 4.65 on the Hs 
scale), a number of the other differ- 
ences approached statistical signifi- 
cance. The pattern is one in which all 
of the scales except L, F and D are high- 
er in the group having a C sum of 2.5 
or more. This differentiation in the pat- 
tern is revealed in Table I. 

Item analyses were made of the 100 
MMPI records in relation to sum C and 


TABLE I 
MEAN SCORES ON THE MMPI IN RELATION TO 
Sum C SCORES ON THE GROUP RORSCHACH 














Mean Mean 

Scores Scores 
MMPI C sum C sum S.D. 
Scales 2.5-+ below 2.5 of 

(N=41) (N=59) D diff. C.R. le. 
L 53.45 53.70 — .25 — — n.s. 
K 54.45 53.45 +-1.00 — — n.s. 
F 55.05 55.20 — .15 = — n.s. 
Hs 52.85 48.20 + 4,65 2.17 2.14 5% 
D 54.70 54.65 + .05 — = n.s. 
Hy 57.60 55.05 -+-2.55 1.97 1.40 n.s. 
Pd 57.10 54.05 +-3.05 2.09 1.46 n.s. 
Mf 59.80 58.80 -+1.00 —- oa n.8. 
Pa 54.30 51.60 +-2.70 1.86 1.45 n.s. 
Pt 67.10 53.25 +3.85 2.26 1.70 n.s. 
Se 57.50 53.60 -+-3.90 2.17 1.80 n.s. 
Ma 58.45 56.00 -+42.45 2.01 1,22 n.s. 





CF scores, and only those items which 
held in a subsequent validating group of 
41 were considered. The items consider- 
ed, therefore, have discriminated in two 
different populations. It was found that 
a number of responses were common to 
both higher sum C and higher CF 
scores. This, of course, can be explained 
by reason of the fact that a high CF 
score would appreciably raise the C sum 
score in each record. The higher CF 
score apparently is correlated with lack 
of regard for social conventions and 
lack of consideration for the feelings of 
others which at times approximates an 
active negativism; however, this does 
not reach the excited manic level. A high 
degree of self-confidence, what one 
might term in this instance ego-infla- 
tion, apparently is correlated with a 
rather inadequate super-ego develop- 
ment. Certainly there is a lack of re- 
serve or inhibition in social attitudes. 

It appears that a higher C sum score 
is correlated with a mild Hypomanic 
tendency. One might say also that there 
is a tendency towards individualism, as 
exemplified in “true” responses to items 
such as “When I was a child I did not 
care to be a member of a crowd or gang”’ 
and “false” response to “I feel it is cer- 
tainly best to keep my mouth shut when 
I am in trouble.” Other items which 
tend to indicate uninhibited social be- 
havior are “false” responses to: “I have 
never done anything dangerous for the 
thrill of it”, and “I have sometimes 
stayed away from another person be- 
cause I feared doing or saying some- 
thing that I might regret afterwards.” 
This higher C sum group is further 
characterized by self-confidence and 
freedom from embarrassment. 

Before summarizing these findings, a 
reference to traditional interpretations 
of Rorschach color responses is in order. 
In the color triad (C, CF, and FC) de- 
velopmentally FC is an advance over CF 
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and CF an advance over pure C; it has 
been held that this development runs 
from the extreme ego-centricism of the 
pure C response to a moderate allo- 
centricism of the FC response. Well- 
adjusted, socially accepted affect is gen- 
erally considered to be found in the FC 
answer. On the other hand, the CF in- 
dividual, according to Bochner and Hal- 
pern [3, p. 43] is “inclined to im- 
pulsiveness and generally susceptible to 
emotional stimuli.” Beck [2, p. 29] 
states that FC “requires feeling in tune 
with that of others, and in fact in- 
dicates understanding of others through 
the medium of the feelings.” The item 
analysis of one group of MMPI records 
leads to the belief that there is a point 
at which a greater number of FC re- 
sponses may tend to indicate maladjust- 
ment, that is, if overcaution in social 
standards, indecision and self-depreci- 
ation can be indicated as belonging to 
maladjustment. It is noted that this find- 
ing is in line with that of Harris and 
Christiansen [4] who reported that 
negative weights were given to both FC 
and CF in predicting response to psy- 
chotherapy; that is, these scoring cate- 
gories appeared more frequently in the 
poorer prognostic group. These authors 
further state, “Although some of these 
weights do not agree with interpre- 
tative conventions, particularly the neg- 
ative weight for FC, their derivation 
was empirical.” 

The difference of the means on the 
MMPI subscales indicates that malad- 
justment tends to be correlated with 
higher sum C scores. In this instance, 
the difference on the Hs score is one 
which is of greatest statistical signifi- 
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cance. In terms of the analysis of the 
items of the MMPI in relation to the 
CF scoring category, the findings large- 
ly are in accord with traditional 
Rorschach interpretation; that is, a 
greater number of CF responses is link- 
ed with impulsiveness and a lack of 
social consciousness. The findings here- 
in, however, point to an additional in- 
terpretation in that hypomanic trends 
and overconfidence seem to be tied in 
with this higher CF and higher C sum 
scores. The finding of maladjustment 
linkage with higher C sum scores is also 
corroborated by Thompson’s finding of 
a negative relationship between high C 
sum scores and college achievement. 

Admittedly, some of these findings are 
tentative. It is believed, however, that 
the attempt to present an objective 
method of evaluating Rorschach scoring 
determinants has been successful and 
may indicate the way to a Rorschach 
methodology other than subjective ap- 
praisal. 
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FREQUENCIES OF THEMES AND IDENTIFICATIONS 
IN THE STORIES OF SCHIZOPHRENIC PA- 
TIENTS AND NON-HOSPITALIZED 
COLLEGE STUDENTS’ 


By LEONARD D. ERON 
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INCE the introduction of the TAT 
S in 1935 [16], the technique has had 
a wide and varied application in clinical 
situations and in research. According to 
a recent survey it is one of the two most 
widely used tests of personality [13] 
and an extensive body of literature con- 
cerned with it has accumulated. The 
validity and reliability of the test have 
been reasonably well established [4, 5, 
6, 9, 11, 15, 21] and much has been writ- 
ten of its clinical applications [10, 12, 
14, 18, 19]. However, one of the serious 
deficiencies in the literature is the lack 
of adequate normative data for the test. 
Many investigators state different char- 
acteristics as representative of the same 
clinical group and the same character- 
istics as representative of different clini- 
cal groups [10, 14, 18, 19, 20]. None of 
them, however, give frequencies sub- 
stantiating these diagnostic cues. 
Rather, they seem to be the result of the 
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total subjective impression left with the 
clinician after the examination of many 
patients with a given diagnosis. How- 
ever valid these assumptions may be, 
they cannot be accepted by others with- 
out scientific verification based on actual 
numbers of patients of a given clinical 
group exhibiting these characteristics, 
the presence of which distinguishes 
them from other clinical groups and 
from normal individuals. The necessity 
for a clear-cut statistical treatment is 
obvious. This paper represents an at- 
tempt to secure some information about 
the actual themes made up in response 
to the test cards, and the identification 
of the characters in the pictures. 


SUBJECTS AND PROCEDURES 


The 50 subjects used in this study 
were all male veterans of World War 
II. They comprised two groups of 25 
each. Group I consisted of hospital pa- 
tients with a final diagnosis of schizo- 
phrenia and Group II consisted of non- 
hospitalized college students. The two 
groups were distributed according to 
age, education, mental ability and mari- 
tal status as shown in Table I. Obviously 
they are very comparable in respect to 











TABLE I 
AGE, EDUCATION, MENTAL ABILITY, AND MARITAL STATUS OF SUBJECTS 
Age Education hs ha iQ Number 
Group N Range Mean Range Mean Range Mean Married 
Schizophrenic.................. 25 20-34 246 12-17 184 «#£«4100-188 113 7 
College Student.............. 25 20-34 24.4 13-16 13.9 5 
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these variables, with the ranges and 
means almost identical. No IQ scores 
were available for the college students, 
but it is assumed they are at least of 
average intelligence, and it has been re- 
ported in the literature [20] that after 
a normal intelligence level has been 
reached, there is no correlation be- 
tween quantity and quality of material 
and added increments of intelligence. 
Thus it is felt that this factor is also 
adequately controlled. All 20 cards rec- 
ommended for adult males (Harvard 
University Clinic, 3rd edition) were ad- 
ministered to all subjects by the same 
examiner according to the standard 
directions of Murray [17] with one ex- 
ception. All pictures were presented at 
one session with a 15 minute break be- 
tween halves. This was necessitated by 
hospital procedure. However, control 
subjects were treated in the same man- 
ner. 

After all the protocols had been col- 
lected, they were perused at least twice. 
The first time, each story was read 
through and the action taking place was 
summarized in a few words. After this 
was done for all the stories, the author, 
with the help of another psychologist, 
examined the summaries and identified 
three variables for later analysis — the 
theme, identification of central charac- 
ter, and level of interpretation. A check 
list of 98 themes was organized under 
the two general headings of disequil- 
ibrium and equilibrium, indicating the 
state of tension or adjustment displayed 
in the story. These two general groups 
were subdivided into interpersonal, in- 
trapersonal, and impersonal classifi- 
cations, depending upon the sphere to 
which the situation was referred. The 
interpersonal classification was further 
broken down into sections dealing with 
parent, partner, peer, and sibling. Each 
theme appearing in the classification 
was named and defined and examples of 
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each given, so that the same list could 
be used in further research. The stories 
were then again examined in random 
order and the frequency of appearance 
of each theme on the check list was 
noted. Interpretation was kept to a 
minimum. Covert significance of the 
items was disregarded and only that 
actual behavior which occurred in the 
stories and was related by the narrator 
was used in the classification. There 
were no restrictions as to the number of 
themes per story and as each theme in 
the criterion list appeared it was tallied. 
For each story also, the identification 
of the characters was noted, and the 
level of interpretation, that is, whether 
the story was narrative, descriptive, 
symbolic, imaginary, etc. In collating 
and treating the results, an attempt was 
made to: (1) find any group differences 
between the schizophrenic subjects and 
the college students, and (2) determine 
differences in responses of the whole 
group to the individual test cards; that 
is, the problem of “picture pull”. 


RESULTS 


A total of 1,000 stories, containing 
1,988 themes was recorded for all the 
subjects. The outstanding feature in the 
comparison of the two groups of sub- 
jects is the striking similarity between 
them. Although the college students are 
more productive, the difference in the 
total number of themes produced by 
either group is not significant. (total 
schizophrenic stories, 963; total student 
stories, 1,025) With rare exceptions 
there was no theme which appeared in 
one group and was absent from the 
other. In the few categories in which 
this did occur, the frequency in the sin- 
gle group reporting the theme was no 
more than one or two. Over 100 compari- 
sons were made between the two groups 
and differences significant at or beyond 
the 5 per cent confidence level were found 

















THEMES AND IDENTIFICATIONS OF SCHIZOPHRENICS AND STUDENTS 


TABLE II 
FREQUENCIES OF THEMES SHOWING DIFFER- 
ENCES AT OR BEYOND THE 5 PER CENT 
LEVEL BETWEEN SCHIZOPHRENIC PA- 
TIENTS AND NON-HOSPITALIZED 
COLLEGE STUDENTS 











Fre- Fre- 
quency quency 
College Schizo- 

Theme Student phrenic x? P 
moral struggle .................... 15 2 9.1912 .005 
EE 10 2 7.3581 .01 
0 OE a 5 6.7395 01 
parent disequilibrium -.... 185 138 6.6942 Ol 
EP 12 6.0062 .02 
cect EE 5.9431 .02 
death, iJlness of son ........ 18 6 5.5104 .02 
disappointment to parent 19 7 5.0865 .025 
legal restriction ~............ G 22 5.0403 .025 
aggression from imper- 

sonal source ..................... 70 46 4.7067 .05 
peer approbation ................ 10 2 4.6875 .05 
a 34 4.6202 .05 
generalized restriction 

of environment ................ 24 11 4.4643 .05 





in 13 classifications. These appear in 
Table II. It is interesting to note that 
the difference showing the highest con- 
fidence level is one for themes of moral 
struggle in which the students have an 
excess over the schizophrenics. Yet this 
has been given as one of the diagnostic 
cues for schizophrenic stories [18]. If 
one accepts the concept of projection, 
some of the other differences can be ex- 
plained in terms of the accepted dynam- 
ics of schizophrenia. Themes of curiosi- 
ty and retirement are generally neutral 
in feeling tone and fit in with the picture 
of flattened affectivity. That these schizo- 
phrenes should have more themes of 
legal restriction is understandable since 
at the time of administration of the test 
they were patients in a mental hospital, 
many of them involuntarily so. Signifi- 
cantly fewer themes of aspiration and 
self-esteem on their part can be ex- 
plained perhaps by feelings of inade- 
quacy and loss of interest in the future; 
and of peer approbation, by their lack 
of concern over success in interpersonal 
relations. That college students should 
produce significantly more themes of 
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moral struggle and illicit sex may be an 
indication of the preoccupation of col- 
lege students with these matters; and 
that they show more themes of parental 
disequilibrium, feeling that they are a 
disappointment to their parents, may be 
due to the fact that as college students 
they are closer to the parental situation 
than these hospital patients. 

Other differences which are not sta- 
tistically significant according to our 
criterion of the 5 per cent confidence 
level but which may still show a trend 
and which are interesting in the light 
of some of the literature both on the 
TAT and schizophrenia in general are 
as follows. At the 10 per cent confidence 
level, college students contribute more 
themes of guilt and remorse and at the 
20 per cent level more themes of pres- 
sure from parents, filial obligation, be- 
longingness, and mental abnormality. 
Also the difference in the total number 
of themes of disequilibrium for the two 
groups is significant at the 20 per cent 
confidence level with the students con- 
tributing more of these themes. Schizo- 
phrenes give more themes of religion, 
retribution, succorance from parents, 
pressure from heterosexual partner, and 
illness or death of heterosexual partner, 
all at the 20 per cent confidence level or 
better. The fact that schizophrenes do 
not produce as many themes of guilt or 
remorse does not fit in with the common 
picture of this type of personality dis- 
turbance, but when considered along 
with the excess of themes of retribution 
the possibility is suggested that they are 
concerned more with the payment of 
formal penalties for misdoings than 
with anxiety-laden feelings of guilt over 
them. Their comparative excess of 
themes of religion and lack of themes of 
belongingness would be expected and 
the fact that they show more themes of 
pressure from the partner and death of 
partner may be indicative of less satis- 
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factory heterosexual adjustments. More 
themes of succorance from parents is 
perhaps a represeitation of the essential 
immaturity of schizophrenics, while less 
of other parental themes is in keeping 
with what has already been stated. 
Schizophrenics give more descriptions 
and less narratives for the pictures 
which might show a lack of emotional 
involvement and a tendency towards 
evasiveness. An unexpected finding is 
that the college students give more 
imaginary and symbolic stories than do 
the schizophrenics (at the 10 per cent 
and 20 per cent confidence levels re- 
spectively). From descriptions of schiz- 
ophrenic behavior it would be expected 
that they would produce more of this 
type of story and this has indeed been 
listed by some investigators as a diag- 
nostic cue [10, 18, 20]. 

While mentioning these differences 
between the two groups, it is important 
to bear in mind the even greater simi- 
larity between them and the large 
amount of overlap between their mem- 
bers in any given category. This cor- 


TABLE III 
Most FREQUENT THEMES APPEARING IN 1000 
TAT SToRIEs OF 25 MALE SCHIZOPHRENIC 
PATIENTS AND 25 NON-HOSPITALIZED 
MALE COLLEGE STUDENTS 














Frequency* 
Entire College Schizo- 
Theme group students phrenics 
aggression, impersonal source 116 70 46 
pressure from parents ......... 106 61 45 
er 63 38 
economic pressure ................... 60 30 30 
mental disturbance ................ 59 36 
guilt-remorse ........................... 54 34 
CO EE 30 
a 32 
retir SD T Sinasnenuiiaieteisiiinneisintndiniiieg 52 34 
Ee 28 
RRR SS ee SREP Ae a en 27 
death or illness of partner... 26 
contentment with partner...... 25 





*Included in frequency for entire group are only those 
themes which had a frequency of at least 50; and in fre- 
quency for the individual groups, only those with a 
frequency in that group of at least 25 
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responds to what has been found in an 
earlier investigation of the emotional 
tone and outcome of TAT stories in 
which this author participated [7]. 
There are no broad group differences. 
At least some of the schizophrenics fall 
into every one of the normal categories 
and only very few patients have ex- 
clusively “schizophrenic” characteris- 
tics. Responses on the TAT are deter- 
mined more by the actual stimulus cards 
themselves, it would seem, than by the 
specific personality syndrome of the sub- 
ject. 


TABLE IV 

FREQUENCY OF THEMES OF EQUILIBRIUM AND 

DISEQUILIBRIUM FOR EACH PICTURE IN 
Stores TOLD BY ALL SUBJECTS 











Disequi- Equi- 
Picture librium librium x? P 

— aa ll 82.1158 001 
a 18 31.8027 001 
eae $2 5 77.1365 -001 
Iv. en 22 68.8859 001 
MY dhisnStbepdusenuidbipmeaied 59 12 80.4542 -001 
VI BM . es, 7 125.3742 -001 
. & enn ‘ 80 2 71.3689 -001 
ee ee. tes ee 3 63.5559 001 
IX BM niinttind 40 55 2.2132 

ee. mieoiabens 32 47 2.6614 

i re ee 69 4 56.9897 -001 
91 23 39.9671 001 
Xill MF - 134 1 130.0463 001 
a 79 28 28.8341 001 
Be Nisicitciintacainad 110 10 82.5021 -001 
XVI aiid x 40 29 1.5978 

XVII BM . 53 37 2.6694 

XVIII BM 119 3 109.3463 .001 
os 32 15 5.7925 025 
TE thanen-cutleshaaeiiaatotas 110 5 94.9587 -001 





We come then to a consideration of 
the types of themes elicited by the dif- 
ferent pictures. Table III contains a list 
of the themes appearing most frequent- 
ly for the whole test, and it is apparent 
that there are certain themes which the 
TAT evokes rather consistently in both 
types of subjects. This table is self ex- 
planatory and no further comment need 
be made about it. As can be seen in 
Table IV, 16 of the 20 cards elicit sig- 
nificantly more themes of disequilibrium 
than equilibrium. Of the four remaining 
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cards, only two, IXBM and X show an 
excess of themes of equilibrium, but in 
neither case is this difference significant 
beyond the 10 per cent level. In making 
this analysis and also those to follow, 
schizophrenic and normal stories were 
pooled. This is justifiable because a 
picture-by-picture comparison between 
the two groups for differences in total 
number of themes of disequilibrium or 
equilibrium told by either group reveal- 
ed only one significant difference at the 
5 per cent level (college students give 
more themes of equilibrium for picture 
number XVIIBM than do the schizo- 
phrenics), and this is less than could 
be expected by chance. The two groups 
can thus be treated as comprising a 
homogeneous population insofar as this 
variable is concerned. It is obvious from 
Table IV that themes of disequilibrium 
are the usual response in the TAT, at 
least for the cards here considered. 
Much has been written of the con- 
fusion of sex of the characters depicted 
on the cards and its significance as an 
indication of a high feminine component 
in the male personality [10, 18, 20]. In- 
stances of sex confusion, that is, inter- 
pretation of a male character as female 
or indecision as to whether male or fe- 
male, are tabulated in Table V. There 


TABLE V 


NUMBER OF STORIES SHOWING CONFUSION IN 
IDENTIFICATION OF SEX OF 











CENTRAL CHARACTER 
Non- Con- 

Picture confused fused* x? P 

III BM .......... 31 19 2.6450 .20 
. ae 49 1 45.1250 .001 
OE Wishsikabcsisnincntince 48 2 41.4050 .001 
pC 45 5 31.3050 .001 
| 49 1 45.1250 .001 
MSS 45 2 38.4809 001 
i 40 4 28.6420 .001 
\ ae 88 13 12.0050 .001 





*Central character considered female, or story teller 
is undecided as to whether male or female. 
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were confusions noted on eight different 
cards, and in all there were 47 instances 
of this phenomenon in the complete set 
of 1,000 stories. For one picture, LIIIBM, 
19 subjects were confused and 31 non- 
confused. This difference is significant 
only at the 20 per cent confidence level, 
therefore it would seem difficult to say 
with assurance that misrecognition of 
the sex of this character is an indication 
of sex confusion, since significantly 
more males do not see it as a male than 
see it as a female. A possible inter- 
pretation of this finding might be that 
it is a function of the stimulus proper- 
ties of the card more than a projection 
of the subject’s female identification. 
The same can not be said of the other 
cases of misrecognition, however, be- 
cause in all of them a significantly great- 
er number of subjects identify the 
character properly than err in identifi- 
cation. It is interesting to note that al- 
TABLE VI 
A COMPARISON OF THE RELATIVE FREQUENCIES 


OF DIFFERENT CATEGORIES FOR THE FIRST 
AND SECOND TEN PICTURES 


Category I-X XI-XX x? P 
Total number 

of themes ........ 999 989 0045 .95 
Total dis- 

equilibrium 822 8387 1276 .80 
Total 

equilibrium 177 152 1.8245 .20 
Total parent ...... 311 58 172.7812 01 
Total peer .......... 60 117 18.0353 .001 
Total partner ... 163 148 6760 .50 
Total sibling ...... 10 5 1.3500 .30 
Total 

interpersonal . 544 328 53.5371 .001 
Total 

intrapersonal . 338 469 21.1032 .001 
Total impersonal 117 192 17.9620 .001 
Total num- 

ber symbolic .. 5 26 13.5565 .001 
Total number 

descriptive -..... 2 18 7.3500 01 
Total number 

imaginary ...... 7 26 10.3712 01 
Total number 

fairy tale ........ 0 17 16.0147 001 
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together the college students have more 
instances of sex confusion than do the 
schizophrenic patients, but a chi square 
of homogeneity shows that these two 
groups do not differ significantly in re- 
spect to this variable. 

Finally the data have been examined 
to see if there are any differences in 
types of themes evoked by the first and 
last ten pictures. As shown in Table VI 
there is little difference in the total 
number of themes elicited by either half 
of the test, and this applied to both 
themes of equilibrium and disequilibri- 
um, although in the latter case the dif- 
ference is somewhat larger, but signifi- 
cant only at the 20 per cent confidence 
level. The data show also that interper- 
sonal themes predominate significantly 
in the first half of the test and intraper- 
sonal and impersonal in the latter half 
of the test. Also significantly more sym- 
bolic, descriptive, imaginary and fairy 
tale themes are told for the second series 
of pictures. These differences are no 
doubt a function of the greater vague- 
ness and ambiguity of the last ten pic- 
tures and also of the instructions after 
the tenth card to make the stories as 
imaginative as possible. These results 
are in line with Murray’s contention 
that stories composed in the first session 
are more closely related to the outer 
layer of personality (an individual’s 
public behavior) than those composed 
in the second session, many of which ex- 
press inner layer tendencies and com- 
plexes symbolically. 


CONCLUSIONS 


1. Results of this study indicate that 
thematic material obtained on the TAT 
is very much a function of the stimulus 
properties of the cards themselves and 
that the specific personality disturbance 
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of the subject is not nearly so important 
in determining the type of theme that 
individuals will produce. Every theme 
appearing for normal subjects is also re- 
lated by at least some schizophrenics 
and in over 100 comparisons made be- 
tween the two groups there were dif- 
ferences found in only 13 categories 
which were significant at or beyond the 
5 per cent level of confidence. 


2. For 16 of the 20 cards under in- 
vestigation in this study there is a wide 
and significant difference in the number 
of themes of equilibrium and disequilib- 
rium, favoring the latter. 


3. In one card, IIIBM, the number 
of subjects confused over the sex of the 
central character does not differ signifi- 
cantly from those not so confused. 


4. The first ten cards produce sig- 
nificantly more interpersonal themes 
than the second ten, and the latter, sig- 
nificantly more intrapersonal and im- 
personal than the former. The second 
half also calls forth significantly more 
symbolic, imaginary, fairy tale, and de- 
scriptive stories than the first half. 

5. In the light of these results it is 
felt that the individual examiner must 
be cautious in using the TAT as a diag- 
nostic instrument and applying the cues 
reported in the literature by various in- 
vestigators. In making a valid inter- 
pretation of any given protocol, due con- 
sideration must be given to the stimulus 
provided by the cards themselves which 
seem to be a more potent factor in deter- 
mining the type of theme related than 


the psychiatric classification of the in- 
dividual. 


6. Table VII shows the picture-by- 
picture tabulation of the most common 
themes appearing in the 1000 TAT stor- 
ies of the combined group of 50 subjects. 
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TABLE VII 


PICTURE BY PICTURE TABULATION OF THE MOST 
COMMON THEMES APPEARING IN 
1000 TAT SToRIEs 


Included in this table are responses of 25 hospitalized 
schizophrenics and 25 non-hospitalized college students. 
Both groups are comparable in terms of age, education, 
sex, IQ, veteran status, marital status. All are male 
veterans of ages 20 to 34 years, with 12 to 17 years edu- 
eation, and an IQ of at least 100. Twelve are married 
and thirty-eight single. All themes related by at least 
10 subjects for each picture are included. 











FRE- 
THEME DEFINITION QUENCY 
Picture I 
pressure from parent figures are prohibitive, 
parents compelling, censuring, punishing, 
quarreling with child ...0......... 26 
aspiration dreaming of future, hoping for 
future, determination .............. 26 
vacillation wasting time putting off a dis 
tasteful task, procrastination, 
I 
curiosity wondering or inquiring about 
construction of object ............ ll 
inadequacy realization, whether justified or 
not, of lack of success . ............ 10 
belongingness desire expressed to be with or 
accepted by peers ...................... » 
Picture Il 
aspiration dreaming of future, hoping for 
future, determination —............. 26 
economic compelled to or prohibited from, 
pressure or limited in doing something 
because of lack of money ........ 21 


Picture III BM 


pressure from parent figures are prohibitive, 











parents compelling, censuring, punishing, 
quarreling with child 0... 13 
suicide attempted or completed, preoecu- 
pation with . a 
generalized re- environment is queen frus- 
striction touting con. 12 
Picture IV 
pressure from partner is prohibitive, compel- 
partner ling, censuring, punishing or 
quarrling, etc. 20 
partner a positive relationship, sets at 
comforts ease, concilistes, regales ............. 18 
Picture V 
pressure from parent is prohibitive, compelling, 
parents censuring, punishing, quarreling 
with child 20 
ourlosity wondering about construction of 


object, contents of room, ete. . 12 


Picture VI BM 
pressure from parent is prohibitive, compelling, 


parent censuring, punishing, quarreling 
with child 21 
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TABLE VII (Continued) 
FRE- 
THEME DEFINITION QUENCY 
departure from child is taking leave of parental 
parent Ee ee 18 
filial obligation child feels it his duty to remain 
with, comply with, or support 
a 13 
disappointment child does not live up to parent's 
to parent expectations wiaptaaienatamtmeings 13 
concern of parent is worried over Porn 
parent or mental well-being of child .. 11 
aggression robbery, accident, murder, (of 
toward unapecified individual) 10 
environment 
Picture VII BM 
succorance child seeks or receives aid, ad- 
from vice, consolation, protection from 
parents parent saiensieeoremiananate wettes Ge 
pressure from parent is prohibitive, chests, 
parents censuring, punishing, quarreling 
with child . 11 
Picture VIII BM 
aspiration dreaming of future, hoping for 
future, determination ................. 23 
aggression from war, accident, nature, animal, 
impersonal IND cccccncimactnestiaitiallitciceaveninedinmenes 16 
source 
Picture IX BM 
retirement central character asleep, resting, 
Picture X 
partner serenity in marital life, satis- 
contentment faction with partner, marital 
bliss, heterosexual bliss ............. 27 
Picture XI 
aggression from war, accident, nature, animal, 
impersonal a 
source 
aggression to- physical harm inflicted or intend- 
wards peer ed for individual of same sex and 
approximately same age—physical 
violence between two animals .. 18 
Picture XII M 
religion prayer, seeking consolation from 
God, religious conflict, religious 
GREED cts 1 
death or ill- 4 
ness of son 
Picture XIII MF 
guilt-remorse 22 
death or ill- 18 
ness of part- 
ner 
illicit sex extra or pre-marital heterosexual 
relation, non-incestuous .......... 18 
aggression to- physical harm inflicted or intend- 
wards partner ed for heterosexual partner ....... 16 
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TABLE VII (Continued) 











FRE- 
THEME DEFINITION QUENCY 
Picture XIV 
aspiration dreaming of future, hope for 
future, determination ........... 16 
tranquility peace of mind, content with en- 
vironment and own accomplish- 
ments ........ 156 
Picture XV 
death or ill- 17 
ness of part- 
ner 
religion prayer, seeking consolation from 
God, religious conflict, religious 
awakening ........ 16 





Picture XVI—Since there is no individual 


intrapersonal disequilibrium 


category of sufficient frequency, only 
more general categories can be in- 
cluded. 





siasaialiasilintbdarianhinthaiealicinai 17 
interpersonal equilibrium ~.......-22......-.--eccceeeeeeeeees 15 
impersonal disequilibrium ~...................................... 18 
intrapersonal equilibrium -.22...0..2......ccccceceeececeeees 12 
interpersonal disequilibrium —.......-...2.2-..0.....--. 10 

Picture XVII BM 
self esteem egocentricity, self confidence, self 

respect, self approbation —........... 14 

Picture XVIII BM 
drunkenness 22 
succorance seek or receive aid, advice, con- 

from peer solation, protection from peer ... 17 
pressure friends are prohibitive, compel- 
from peer ling, censuring, punishing, quar- 

a 

Picture XIX 

aggression war, accident, nature, animal dis- 
ee a ees ee ne 28 
sonal source 

imaginary 11 
theme level 

Picture XX 
vacillation wasting time, putting off a dis- 

tasteful task, procrastination, 
UII ie. nccnssctncsbeiinalibniuaasenttnaisiniets . 
loneliness central character misses someone, 
is an outcast, friendless, home- 
Ds ccchiinsincneetnintiiniiimne — we ~ 
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THE EFFECT OF DELIBERATE DECEPTION ON MINNE- 
SOTA MULTIPHASIC PERSONALITY 
INVENTORY PERFORMANCE’ 


By HOWARD F. HUNT 


UNIVERSITY OF CHICAGO 


HE USE of a group personality 
test, such as the group form of the 
Minnesota Multiphasic Personality In- 
ventory [2], as a psychiatric or person- 
nel screening device presupposes either 
that the test results are relatively unin- 
fluenced by deliberate attempts to malin- 
ger or to conceal personality defects or 
that some device within the test success- 
fully copes with this deception. Auto- 
matic correction to eliminate the effects 
of such deception would provide an ideal 
solution, but, in the absence of a satis- 
factory correction, the detection of such 
attempts and the identification of liars 
would maintain the usefulness of the 
test for screening purposes. 

The present study was designed to in- 
dicate in an exploratory fashion: (1) 
whether the group form of the Minnesota 
Multiphasic Personality Inventory ( the 
MMPI) can be deliberately falsified in 
such a way as to produce spuriously nor- 
mal and spuriously borderline or abnor- 
mal profiles; (2) whether the K correc- 
tion [4, 5] effectively counteracts at- 
tempted deception by suppressing pro- 
file distortions attributable to lying; (3) 
whether the deception can be detected 
in those profiles which the attempt has 
made appreciably more normal or more 
abnormal; and (4) whether attempted 
deception can be detected as such, re- 
gardless of its effect on the profile. Moti- 


1Supported in part by a Rockefeller Founda- 
tion Grant (Laura Spelman Fund) for the 
School of Social Sciences, Stanford University. 


vated lying is a significant symptom in 
its own right in many screening situa- 
tions. 


PROCEDURE AND RESULTS 


One hundred and nine ASTP students 
in psychology and 74 U.S. Navy general 
court martial prisoners served as sub- 
jects. The ASTP group, at the end of 
training in the MMPI, was divided and 
subjected to the experimental procedure. 
Fifty-three of them took the MMPI un- 
der instructions to conceal their person- 
ality abnormalities as much as possible 
so that they would be certain not to be 
excluded from induction into the mili- 
tary services on psychiatric grounds. 
These are the “fake good” profiles. The 
other 56 ASTP subjects took the MMPI 
under instructions to malinger suffi- 
ciently severe personality abnormality 
to insure a neuropsychiatric discharge 
or psychiatric disqualification for mili- 
tary service. These are the “malingered” 
profiles. The instructions for both 
groups stressed that the falsification 
should be accomplished in such a way as 
to avoid detection. All ASTP subjects 
took the MMPI honestly as a control, 
approximately half before and half af- 
ter the experimental testing. These are 
the “honest” profiles. 

The 74 prisoners submitted to testing 
voluntarily with knowledge of their 
honestly obtained MMPI results as the 
incentive. All of the prisoners took the 
test anonymously under all three con- 
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ditions: honestly, under instructions to 
malinger, and under instructions to con- 
ceal abnormality. The order of the ex- 
perimental conditions varied for this 
group as well, with approximately half 
of the group malingering first and half 
malingering last. All prisoners took the 
MMPI honestly in between the two ex- 
perimental testings. The instructions 
for each experimental condition were 
the same as for the ASTP group except 
that restoration to active duty status 
was added to the goals or reference con- 
ditions for faking good to make the task 
more meaningful for the prisoners. The 
simple instructions for both groups 
were directly stated. No large words or 
innuendoes were employed. 

All subjects were males in late ado- 
lescence or early adulthood. The prison- 
er group contained a larger percentage 
of individuals in the late ’teens than the 
ASTP group. All ASTP subjects had 
been selected for training by the U. S. 
Army and all had had at least several 
years of high school. A number of them 
had attended college for several years. 
All of the prisoners were literate and 
had finished at least the fifth grade. A 
number had had several years of high 
school, none had been to college, and 
many had left school as early as the law 
allowed. All of the prisoners had been 
routinely screened for feeblemindedness 
and patent psychiatric disability by the 
professional staff of the prison. Though 
some of the prisoner group showed 
minor degrees of psychopathy, no pris- 
oner deviated sufficiently to disqualify 
him officially for active military service. 
As far as could be determined, the sub- 
jects in both groups adhered to the ex- 
perimental procedures and cooperated 
quite adequately. 

Each profile was transcribed on an in- 
dividual profile form with all identify- 
ing marks as to subject and experiment- 
al condition removed. The uncorrected 
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and K-corrected profiles were trans- 
cribed separately. Thus, all determi- 
nations from the profile were blind, that 
is, based on profile characteristics alone. 
This seemed more pertinent than sta- 
tistical comparisons between groups for 
single scales since MMPI results are 
generally evaluated in terms of the total 
profile or combinations of scales. 


THE EFFECT OF ATTEMPTED DECEPTION 


All profiles were arbitrarily classified 
as follows: “normal,” if no personality 
scale T score exceeded 64; “borderline,” 
if at least one personality scale T score 
was 65 or more and none exceeded 74; 
and “abnormal,” if at least one person- 
ality T score was 75 or more. The validi- 
ty scales (?, L, and F) and the cor- 
rection scale (K) did not participate in 
this classification. Categories of this 
broad and approximate sort might con- 
ceivably serve in screening to identify 
those applicants requiring individual as- 
sessment. With this classification of the 
profiles, the effect of deception could be 
determined for each subject with refer- 
ence to what might be considered a 
practical screening criterion. 

A variety of comparisons between the 
honest and faked profiles for each sub- 
ject all produced essentially similar re- 
sults. From the standpoint of screening, 
the most relevant data concern the fre- 
quency of “successful” deception or fak- 
ing, that is, how often subjects with 
normal honest profiles could malinger 
borderline or abnormal profiles, and 
how often subjects with borderline or 
abnormal honest profiles produced nor- 
mal MMPI records when attempting to 
conceal personality defects. In other 
words, how often could subjects escape 
by faking from the normal into the 
borderline or abnormal category, and 
vice versa? In screening, a malingering 
applicant whose honest profile is abnor- 
mal accomplishes little by lying. He 
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would have been assessed individually 
anyway. Similarly, the applicant with a 
normal honest profile achieves little by 
faking good since he passes through the 
screening procedure just as he would 
have ordinarily. 

Of the 44 ASTP malingers with nor- 
mal honest profiles, 98 per cent were 
successful in that they produced border- 
line or abnormal profiles by malinger- 
ing. Similarly, all of the 6 prisoners 
with normal honest profiles were able 
to malinger borderline or abnormal pro- 
files. 

Of the 19 ASTP fake good cases with 
abnormal or borderline honest profiles, 
84 per cent produced normal profiles 
when they attempted to conceal person- 
ality defect. Of the 68 prisoners with 
abnormal or borderline honest profiles, 
32 per cent produced normal profiles by 
faking good. The ASTP and prisoner 
groups differed significantly in the fre- 
quency of successful fake good attempts. 

The figures given above, as well as 
those to be reported later, refer only to 
uncorrected profiles. The K correction as 
applied to the personality scales failed 
to reduce the frequency of successful de- 
ception by a significant amount (7? = 
2.0, P > .05) for the prisoner group. 
(This comparison could not be made for 
the ASTP cases since they had‘ partici- 
pated indirectly in the derivation of the 
K scale.) 

The malingering profiles, in compari- 
son with the corresponding honest pro- 
files, frequently showed the characteris- 
tic distortions described by Gough [1]. 
A number were merely elevated, but a 
larger proportion showed appreciable 
elevation in F together with sharp eleva- 
tions in Hs, D, Hy, Pt, and Sc. A few 
showed elevations in Pd or Mf alone. 

In contrast, the fake good profiles dif- 
fered from the corresponding honest 
profiles in a much more variable way. 
Most were lower and of a different 
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shape. For the most part they looked 
exactly like honest profiles which are 
normal or not too greatly elevated, in 
contrast with the F spike and irregular 
and greatly elevated contour of many of 
the malingered profiles. Usually L was 
low or not sufficiently elevated to excite 
suspicion. In general, K was elevated, F 
low. Ma was sharply elevated in a few 
cases. 

The prisoners showed considerably 
greater variability than the ASTP sub- 
jects in the distortions produced by both 
kinds of deception. For both groups, 
however, profiles based on group aver- 
ages would be quite misleading because 
of the variability in distortion. This ap- 
plies to both the uncorrected and the 
K-corrected profiles. 


THE IDENTIFICATION OF ATTEMPTED DE- 
CEPTION 


A test so readily influenced should 
provide some device for detecting the 
deception if it is to serve effectively by 
itself in screening. Though the L scale 
does not perform this function satis- 
factorily, other scales within the test 
seem to be more effective. Gough, in a 
study on the effect of attempted simu- 
lation of psychosis and psychoneurosis 
on the MMPI (individual form), re- 
ports that four experienced interpreters 
as well as a mechanical interpretation 
of the raw score difference between F 
and K satisfactorily separated simulated 
from honest psychoneurotic and psy- 
chotic profiles [1]. Furthermore, dis- 
crepancies between the exaggerated 
MMPI profile of malingering and the 
clinical appearance of the malingerer 
would aid the competent clinician in 
identifying such cases. As competent cli- 
nicians and MMPI experts may not al- 
ways be available in the screening situa- 
tion, the evaluation of objective indices of 
malingering seems necessary, however. 

The same injunction applies to the 
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problem of identifying attempts to con- 
ceal personality abnormality. Little ex- 
ploratory work has been done in this 
area. Hovey, in a note on two clinical 
cases of verified attempts to conceal ab- 
normality, reports that elevations in K 
and selective sorting of K items charac- 
terized these MMPI records [3]. The 
clinical detection of this sort of de- 
ception is somewhat more difficult than 
the clinical detection of malingering 
since fewer characteristic profile dis- 
tortions emerge. 

A scale for the detection of both ma- 
lingering and faking good was derived 
from part of the data of the present ex- 
periment and abandoned, for practical 
reasons, after the publication of K. Item 
analysis identified a number of ques- 
tions with discriminatory power, but 
the problem of norms for various non- 
faking populations and the question of 
the universal availability of such a new 
scale seemed appreciable handicaps. 
Furthermore, many of the items also 
appeared either in the F or the K scales, 
both of which not only have greater 
general usefulness and availability but 
also are carefully standarized. 

Accordingly, the F raw score minus 
the K raw score became a deception in- 
dex interpreted as follows: F-K = +11 
or more suggested malingering, F-K 
values between +10 and —10 suggested 
honest performance, and F-K = —11 or 
below in the negative direction suggest- 
ed faking good. These tentative cutting 
scores were determined in advance quite 
arbitrarily from inspection of a number 
of MMPI records of various sorts, in- 
cluding a few of the ASTP protocols, 
and from rough estimates of the possible 
frequencies of F-K values for honestly 
performing subjects under various cir- 
cumstances. These cutting scores allow 
for slight elevations in F and some re- 
ductions in K which might be expected 
in persons subjected to the tensions of 


screening. This application and inter- 
pretation of F-K seemed fairly consist- 
ent with the content and character of 
these two scales as well as with clinical 
experience, 

Because the ASTP cases had partici- 
pated indirectly in the derivation of K 
and because of the large educational and 
cultural differences between the ASTP 
and prisoner groups, provision for 
cross-validation within the prisoner 
group seemed necessary. Accordingly, 
the prisoners were divided into two 
samples on the basis of the time at 
which they were experimentally tested. 
The first sample contained 34 cases 
while the second contained 40. 

The experimental profiles for the 
ASTP and then the two prisoner 
samples separately were mechanically 
sorted in accordance with the tentative 
cutting scores for F-K. The ASTP cases 
supplied an initial check on the cutting 
scores while the prisoner samples pro- 
vided cross-validation on an entirely 
different sort of sample. 

In addition, the MMPI records (in- 
dividual form) obtained routinely from 
a group of 173 male psychiatric pa- 
tients on admission to a Veterans Ad- 
ministration neuropsychiatric hospital 
were sorted according to these cutting 
scores. These cases were included to de- 
termine whether diagnosed psychiatric 
disability produced F-K values similar 
to those encountered in deception. The 
sample included 48 profiles invalidated 
because of elevated ?, L, or F scores. 
Because some of these patients were 
rather defensive upon entering the hos- 
pital and because the question of eligi- 
bility for special benefits occurred in 
other cases, the universal candor of this 
population can hardly be assumed. If 
anything, however, these conditions 
should lead to an overestimation rather 
than an underestimation of the fre- 
quency of F-K values suggesting de- 
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ception in a population of psychiatric 
patients. 

F-K seems quite effective in detecting 
attempts to malinger. Of the 56 malin- 
gered profiles produced by the ASTP 
group, 88 per cent were correctly identi- 
fied and only 2 per cent of the honest 
profiles were misidentified as malin- 
gered. Of the 34 malingered profiles 
from the first prisoner sample, 85 per 
cent were correctly identified while 3 
per cent of the honest and 6 per cent of 
the fake good profiles were miscalled. 
Similar results occurred for the second 
prisoner sample of 40 cases. Eighty- 
eight per cent of the malingered pro- 
files for this sample were correctly 
identified at a cost of 20 per cent of the 
honest and 7 per cent of the fake good 
profiles misidentified as malingered. 
Moreover, F-K correctly identified 86 
per cent of the 43 successful ASTP ma- 
lingerers and all 6 of the successful 
prisoner malingerers. 

Diagnosed psychiatric disorder did 
not seem to produce an undue pro- 
portion of F-K values above the malin- 
gering cutting score. Twelve per cent of 
the VA neuropsychiatric profiles showed 
F-K values of +11 or above in compari- 
son with the 2 per cent, 3 per cent and 
20 per cent of the honest profiles with 
similar scores in the ASTP and the two 
prisoner samples respectively. 

The situation with regard to identify- 
ing fake good profiles is much less en- 
couraging. Though all of the ASTP pro- 
files on which faking good was success- 
ful were correctly identified, 93 per cent 
of the honest ASTP profiles showed F-K 
values suggestive of faking good. The 
F-K overlap between honest and fake 
good profiles was almost complete for 
the ASTP population. 

F-K identified fake good profiles 
somewhat more adequately in the pris- 
oner samples, however. Values of —11 
and below correctly identified 62 per 
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cent of the 34 fake good profiles in the 
first prisoner sample and miscalled 18 
per cent of the honest profiles. When ap- 
plied to the second prisoner sample of 
40 cases in cross-validation, this cutting 
score correctly identified 55 per cent of 
the fake good profiles, misidentifying 12 
per cent of the honest and 2 per cent of 
the malingered profiles. Moreover, 91 
per cent of the 11 and all 12 of the suc- 
cessful fake good attempts in the two 
prisoner samples respectively were cor- 
rectly identified. Because 32 per cent of 
the neuoropsychiatric profiles looked 
like fake good papers in terms of F-K 
and because of the appreciable error as- 
sociated with the mechanical application 
of this indicator, more work must be 
done before it can be definitely evalu- 
ated. 

The data on detection of honest pro- 
files with F-K values between +10 and 
—10 provide similarly suggestive but in- 
conclusive evidence. The overlap be- 
tween the ASTP honest and fake good 
F-K distributions was almost complete, 
as described above. Only 12 per cent of 
the malingered profiles in the ASTP 
sample erroneously appeared to be 
honest, however. Again, the prisoner 
samples produced somewhat more en- 
couraging data. For the first prisoner 
sample, 80 per cent of the honest profiles 
were correctly identified, with 15 per 
cent of the malingered and 32 per cent 
of the fake good profiles misidentified 
as honest. For the second prisoner 
sample, 68 per cent of the honest profiles 
were correctly identified, with 10 per 
cent of the malingered as well as 38 per 
cent of the fake good profiles misclas- 
sified. 


DISCUSSION 


The simple, direct, rather naive de- 
ception requested in this experiment 
was intended to represent a sort of 
socio-psychological lowest common de- 
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nominator of the varieties of deception 
usually encountered in screening. This 
limits the generality of the results for 
detection of the more subtle and idio- 
syncratic deception to be expected, 
particulariy among intelligent and so- 
phisticated subjects. The detection of 
successful and subtle liars presents dif- 
ficult problems, particularly with regard 
to reliable criteria and sampling. Only 
the more obvious and ineffective reveal 
themselves unwittingly. Furthermore, 
the accumulation of norms for known 
honest and mendacious samples is dif- 
ficult. Deception, both conscious and un- 
conscious, appears with disconcerting 
frequency in the populations convenient- 
ly available for norm purposes. Anony- 
mity may introduce a different sort of 
distortion as well. Thus, norms should 
probably be collected for separate 
groups and conditions rather than com- 
bined for large and heterogeneous 
samples. What constitutes significant 
deception is probably relative to the 
specific group and its cultural back- 
ground as well as to the situation; com- 
bination of diverse groups may even ob- 
scure the significance of deviations in 
some instances, 

The notable contrast between the 
ASTP and prisoner groups with regard 
to detection of honest and fake good per- 
formance from F-K requires expla- 
nation. Several group tendencies prob- 
ably contribute to this discrepancy. 
Groups characterized by superior socio- 
economic status tend to show elevation 
in K [4]. The similar elevation found 
for the ASTP sample could be attributed 
to this factor, assuming the superior 
educational status of these subjects re- 
flects superior socio-economic origins. 
This K elevation, as it was not ac- 
companied by elevation in F, would tend 
to increase the frequency of negative 
F-K values among the honest ASTP 
papers, placing many of them in the 
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fake good range for this index. In con- 
trast, the K distribution for the prison- 
ers was not atypical. They did show, 
however, some elevation in F raw score 
such as frequently appears in the rec- 
ords of persons having difficulties, situa- 
tional and otherwise. The contrasting 
group trends in F and K should make 
large negative F-K values more frequent 
among the honest ASTP records than 
among the honest prisoner records, pro- 
ducing a larger number of incorrect 
identifications of honest profiles as fake 
good attempts for the ASTP group. This 
occurred; 15 per cent of the honest 
prisoner profiles (both samples com- 
bined)as compared with 93 per cent of 
the honest ASTP profiles were confused 
in this way, a highly significant differ- 
ence in the expected direction. Similar- 
ly, these group F and K trends should 
make large positive F-K values more 
frequent among the prisoners, with con- 
sequently more misidentification of hon- 
est profiles as malingered. The group 
data tend to confirm this hypothesis; 12 
per cent of all the honest prisoner pro- 
files as compared with 2 per cent of the 
honest ASTP profiles were misidentified 
as malingered, a difference of borderline 
statistical significance (CR = 2.4). 
Some of the error associated with the 
mechanical application of F-K probably 
could be eliminated by adjustment of 
the cutting scores in accordance with 
more adequate normative data. The cut- 
ting scores used in the present experi- 
ment were both arbitrary and tentative. 
Such an adjustment, however, would 
hardly be sufficient to separate fake 
good and honest profiles in a group of 
educated and presumably economically 
favored subjects such as the ASTP 
cases. The overlap was too great. Fur- 
ther research must establish the kinds 
of cases to which F-K may be validly 
applied to detect both malingering and 
faking good. This is particularly neces- 








sary in connection with the use of F-K 
on female subjects since the present 
study included males only. 


SUMMARY 


Deliberate deception, in the limited 
sense employed in this study, can in- 
fluence performance on the group form 
of the MMPI by appreciably distorting 
the profile in accordance with the intent 
to malinger or to conceal personality ab- 
normality. This was established for two 
groups, one consisting of 109 ASTP sub- 
jects and the other 74 U.S. Navy gener- 
al court martial prisoners. 

The K correction, as applied to the 
personality scales, does not appear to 
correct adequately for the profile dis- 
tortion produced by deception. 

The F-K index correctly identifies a 
substantial proportion of the malinger- 
ed profiles in both groups of subjects 
without misidentifying an undue num- 
ber of honest and fake good profiles. 
Psychiatric disorder does not appear to 
produce F-K values suggesting matin- 
gering with undue frequency. 

The F-K index serves somewhat less 
adequately, however, in the detection of 
honest and fake good profiles for a 
sample of general court martial prison- 
ers. Though it correctly identified al- 
most all of the successful attempts to 
conceal abnormality, the overlap be- 
tween the F-K distributions for the fake 
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good and honest profiles was appreci- 
able, as well as greater than the cor- 
responding F-K overlap between honest 
and malingered profiles. The F-K over- 
lap between honest and fake good pro- 
files was almost complete for the ASTP 
sample. The index appears valueless for 
this discrimination in such a population. 

The F raw score minus the K raw 
score appears to have some value for the 
detection of this simple, direct, and 
naive sort of deception. Further cross- 
validation as well as the careful ac- 
cumulation of norms to determine ap- 
propriate cutting scores should precede 
clinical application of the index, how- 
ever. 
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[TEM ANALYSIS OF THE PSYCHONEUROTIC SCALES 
ON THE MINNESOTA MULTIPHASIC PERSON- 
ALITY INVENTORY IN EXPERIMENTAL 
SEMISTARVATION’ 


By JOSEF BROZEK anp NANCY KEELY ERICKSON 


LABORATORY OF PHYSIOLOGICAL HYGIENE 
UNIVERSITY OF MINNESOTA 


HE MINNESOTA Multiphasic 

Personality Inventory (MMPI) 
was a part of an extensive battery of 
tests used in a starvation-rehabilitation 
experiment to follow personality 
changes through a semistarvation peri- 
od of six months and a controlled re- 
habilitation period of three months. The 
subjects in this experiment were 32 
young men, considered physically and 
psychologically normal, selected from a 
larger group of conscientious objectors 
who volunteered for the experiment. In 
the course of six months of semistarva- 
tion the group lost an average of about 
one-fourth of their pre-starvation body 
weight and developed the classical 
physical and psychological [5] symp- 
toms of semistarvation. 

The overall MMPI results have been 
reported elsewhere [9]. In summary, 
before the start of semistarvation the 
mean scores for the group were within 
the normal range on all the MMPI scales 
(normal mean standard score = 50, 1 
S. D. = 10). As semistarvation con- 

1The present paper is based on a fraction of 
the material gathered in cooperation with Drs. 
Ancel Keys, Olaf Mickelsen, Austin Henschel, 
Henry Taylor, Ernst Simonson, and Miss An- 
gie Sturgeon in the course of the Minnesota 
starvation-rehabilitation experiment. We wish 
to acknowledge the important part played by 
Mr. Joseph C. Franklin and Mr. Harold S. 
Guetzkow in obtaining the original data on 
which this paper is based, and to express our 
thanks to Drs. S. R. Hathaway and J. C. Mc- 
Kinley for making available to us the frequen- 


cies of abnormal answers to single items in 
their normal and psychiatric groups. 
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tinued, there was a significant elevation 
of scores on the scales of the neurotic 
triad (Hypochondriasis, Hs; Depres- 
sion, D; Hysteria, Hy). This elevation 
tended to decrease steadily during the 
rehabilitation period. The pattern of 
elevation at the end of the semistarva- 
tion period was similar to that found by 
Leverenz [6, p. 620] in a group of 28 
diagnosed cases of depression and by 
Gough [2, p. 25] in a group of 24 cases 
diagnosed as moderate psychoneurosis. 


THE PRESENT PROBLEM 


The standards for the MMPI were de- 
rived from a large normal group and 
from carefully selected samples of psy- 
chiatric patients [3, 4, 7, 8]. Both the 
normal and the psychiatric groups were 
considered to be physically normal. The 
group of semistarved subjects was defi- 
nitely not comparable in physical con- 
dition to the groups on which the MMPI 
was standardized. This difference poses 
the problem whether the score eleva- 
tions observed in this experiment have 
the same interpretative significance as 
they would have in a physically normal 
group. 

Information on the psychoneurotic ef- 
fects of physical disorders in psychi- 
atrically normal groups is limited. It has 
been found that the presence of physical 
illness elevates the Hs score slightly. 
Fifty patients in the general wards of 
the University of Minnesota Hospitals 
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who were free from obvious psychiatric 
disturbances had a mean standard score 
of 58 on the Hs scale; the presence of 
physical symptoms alters the personali- 
ty pattern only moderately in the 
direction of hypochondriasis [7, p. 267]. 
This conclusion is supported by the data 
of Leverenz who found a median Hs 
score of 53 for 105 patients in surgical 
wards [6, p. 620]. In their original 
article on the Depression scale, Hatha- 
way and McKinley [4] reported scores 
from a group of 229 patients in hospital 
wards who did not require psychiatric 
attention ; the men had a mean standard 
D score of 60, the women averaged 55. 

In the semistarvation experiment, the 
mean Hs score was 63. It was ac- 
companied by marked elevations of 
scores on the other two psychoneurotic 
scales (D = 74, Hy = 70). It is im- 
portant to note that all three of the 
elevated scales (Hs, D, Hy) contain a 
large number of somatic complaint 
items. In order to determine the relative 
contribution of the somatic and other 
items to the total scores, an item analy- 
sis was made of the responses on the 
Hs, D, and Hy scales at the control peri- 
od and in semistarvation. As another 
approach to the problem of psychologi- 
cal interpretation of the semistarvation 
changes in the Hs, D, and Hy scales, a 
comparison was made between the fre- 
quencies of abnormal answers to a given 
item obtained for the MMPI psychiatric 
criterion groups and the semistarved 
subjects. 


CLASSIFICATION OF THE ITEMS 


In order to determine the kind of 
items which contribute importantly to 
the score elevations, it seemed desirable 
to divide the total pool of items for the 
three scales into four categories: so- 
matic, psychic, corrective, and subtle. 
These terms do not imply an absolute 
classification of the items and merely 
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serve as convenient labels. Out of the 
total pool of 117 items, 39 were classi- 
fied as somatic, 40 as psychic. It is ob- 
vious that a rigid separation of somatic 
and psychic items is not possible, and 
the present division is to be understood 
as a gross segregation to aid in the 
item analysis. 

The corrective items were added to 
the preliminary D scales by the authors 
of the MMPI to decrease, or correct, the 
number of spuriously high D scores. The 
corrective items showed little increase 
in frequency from normals to depressed 
patients but were present in clinically 
nondepressed persons who had high D 
scores. There are 11 correction items on 
the D scale [4]. 

The term “subtle” has been used by 
some writers to designate a group of 
items not concerned with complaints but 
reflecting a defensive or self-deceptive 
attitude in the subjects. These items fall 
largely on the Hysteria scale. On these 
items, the hysteria patients tend to give 
the apparently “normal” response more 
often than do the normals. The follow- 
ing are representative subtle items (and 
answers): 


I think most people would lie to get ahead. 
(False) 


It is safer to trust nobody. (False) 
At times I feel like swearing. (False) 


The 27 items here classified as subtle 
were checked against the list of Wiener 
and Harmon [10] who have been in- 
terested in the relative contribution of 
“obvious” and “subtle” items to the 
total scores on several of the MMPI 
scaies. Of our 27 items, 25 (93 per cent) 
were included in Wiener and Harmon’s 
list. 


RESULTS: OVERALL CHANGES IN THE 
PSYCHONEUROTIC SCORES 


As background for a more detailed 
analysis of the change in MMPI scores 
under conditions of semistarvation, the 
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TABLE I 
SCORES ON THE PSYCHONEUROTIC SCALES ON THE MINNESOTA MULTIPHASIC PERSONALITY 
INVENTORY IN DIFFERENT PHASES OF A SEMISTARVATION- 
REHABILITATION EXPERIMENT 

Period C* S e a Ri R,s 
Scale Mean S.D Mean Mean S.D. Mean Mean Mean 
Hypochondriasis (Hs)....... 45.7 3.4 58.2 63.0 6.6 55.8 54.1 44.0 
Depression (D)................... 54.2 6.5 64.8 73.9 12.0 66.6 65.7 51.0 

) . . ) ee 59.0 6.1 65.8 70.0 8.2 64.9 








66.5 


59.6 





*© refers to the control (pre-starvation) values, Su and Sx to the 12th and 24th week of semistarvation, Re, 


Rx», and Ras to the respeetive weeks of rehabilitation. N 


mean standard scores on the Hypochon- 
driasis, Depression, and Hysteria scales 
are given in Table I. 


The data indicate a pronounced rise 
in scores on all three scales during semi- 
starvation, followed by a gradual return 
to normal values during nutritional re- 
habilitation. The change was interpret- 
ed as a nonspecific neurosis, with de- 
pression as the dominant feature. In 
contrast with the general rise in the 
psychoneurotic scales, the scores on the 
psychotic scales did not change impor- 
tantly during semistarvation. For the 
purpose of a more detailed analysis the 
items on the Hs, D, and Hy scales will 
be pooled. 


RESULTS: DIRECT ITEM ANALYSIS OF 
THE SEMISTARVATION CHANGES 


In evaluating each item, two fre- 
quencies (f, F) were taken into ac- 
count: the number of men who answer- 
ed a particular item in the abnormal 
direction in the control period (f) and 
during semistarvation (F). The actual 
increase, (F-f), from control to semi- 
starvation in the number of men with 
abnormal responses may be expressed as 
the percentage of the total possible in- 
crease in the number of subjects giving 
such a response, (N-f). This value will 
be designated as 4. Mathematically, 


(7 — f) 


A= 100 X ———. 
(N —f) 


32, except at Rss where N = 20. 


The distribution of the A values is 
given in Figure 1. All the positive values 
denote an increase in the frequency of 
abnormal responses to a particular item 
during semistarvation. The negative 
values at the extreme left of the graph 
indicate a trend toward fewer abnormal 
answers during semistarvation; all of 
these latter changes were small and 
were, therefore, grouped together. The 
median of the distribution is 9, with a 
Q, (the third quartile) of 29. A more or 
less arbitrary value of A = 30 was 
chosen as separating the less sensitive 
from the more sensitive items. The 29 
items which changed in the abnormal 
direction to this extent or more are list- 
ed in Table II where they are divided 
into the four categories discussed above. 
These 29 items will be referred to here- 
after as the “significant” items. 


DISTRIBUTION OF A VALUES 
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NUMBER OF ITEMS 
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Fic. 1. Distribution of the 4 values for all 
items in the Hs, D, and Hy scales of the 
MMPI. 
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TABLE II 
Hs, D, Hy ITEmMs WHICH SHOWED A MARKED INCREASE FROM CONTROL TO THE 24TH 
WEEK OF SEMISTARVATION IN THE FREQUENCY OF ABNORMAL RESPONSES 











N = 32 
ee ae pip” 2 capita % of 
Item iden- possible 
tification increase, 4 Scales 
Somatic Items 
A-5 Fy St, | | eee ena 97 Hs, Hy 
C-17 I am about as able to work as I ever was. (False) Baenks 94 Hs, D, Hy 
A-3 I have never felt better in my life than I do now. (False) 92 D, Hy 
A-40 I feel weak all over much of the time. (True) ................ 88 Hs, D, Hy 
A-42 I have had no difficulty in keeping my balance in walk- 
a eabet he enced 80 Hs, Hy 
G-23 At times I am full of energy. (False) . cccsahibapqeabaneeies’ : 62 D 
A-47 Parts of my body often have feelings like burning, ting- 
ling, crawling, or like “going to sleep”. (True) ........ 59 Hs 
A-16 I seldom or never have dizzy spells. (False) ................ 48 Hs, Hy 
A-2 I am in just as good physical health as most of my 
RR Oe ee ee 44 Hs, D, Hy 
B-27 I wake up fresh and rested most mornings. (False) Bistnat 42 Hs, Hy 
A-4 I am neither gaining nor losing weight. (False) ............ 38 Hs, D 
B-20 I have had no difficulty in starting or holding my bowel 
RT Ee Cee er ees 37 Hs 
A-55 My hands and feet are usually warm enough. (False) . 36 Hs, Hy 
B-10 I hardly ever notice my heart pounding and I am sel- 
EE Is EID wissen nc incceenncccsnciecens 5 33 Hs, Hy 
Psychic Items 
A-24 My judgment is better than it ever was. (False) ............ 85 D 
F-42 I have difficulty in starting to do things. (True) ............ 70 D 
B-36 I dream frequently about things that are best kept to 
I I ia epuahiiienoratniaiaianaat 67 D 
I-27 I find it hard to keep my mind on a task or job. (True) 64 D, Hy 
1-37 I certainly feel useless at times. (True) .....0...00...000000..-.-. 48 D 
E-41 I enjoy many different kinds of play and recreation. 
RS SERRE Teno ape mgm eT OR, Play YE 45 D 
F-44 I have had periods of days, weeks, or months, when I 
couldn’t take care of things because I couldn’t “get 
going”. (True) ........ De ighadataninabic seiiacsivenaiialteciibucieRatiehii 42 D 
C-48 Ee ee EEN res 37 D 
B-2 I cannot understand what I read as well as I used to. 
| See ae 2 ee cpiesneoniahine Game eeiiciateae 32 D 
Corrective Items 
B-8 I have never vomited blood or coughed up blood. (True) 71 D 
B-6 I do not have spells of hayfever or asthma. (True) ........ 60 D 
B-3 I sweat very easily even on cool days. (False) ..... diate 57 D 
Subtle Items 
C-42 I like to read newspaper articles on crime. (False) ...... 69 Hy 
E-3 I feel that it is certainly best to keep my mouth shut 
EL | an ae ae a 46 Hy 


F-5— I wish I were not so shy. (False) .2.0.00000....c.ccccececeeeeees 40 Hy 











ITEM ANALYSIS OF MMPI IN SEMISTARVATION 


The data were evaluated by calcu- 
lating (1) the proportion of significant 
items in the four item categories (so- 
matic, psychic, corrective, and subtle), 
(2) the relative contribution of each of 
the four item categories to the group of 
29 significant items, and (3) the pro- 
portion of the total items on the Hs, D, 
and Hy scales which were found to be 
significant. 


In Figure 2 the A values are plotted 
for each of the four item categories. The 
distributions for the somatic and psy- 
chic items are similar, with the median 
value in both cases falling in the class 
interval 10-14. The corrective and subtle 
items, on the other hand, changed in the 
abnormal direction in fewer of the sub- 
jects, the median A value being close to 
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zero for both distributions. 

he proportion of significant and non- 
significant items in the four item cate- 
gories is indicated in Table III. More 
than a third (36 per cent) of the so- 
matic items were among those desig- 
nated as significant. The per cent of 
significant items in the other categories 
was smaller. 


TABLE Ill 
THE RELATIVE PROPORTION OF THE TOTAL NUM- 
BER OF SIGNIFICANT ITEMS IN 
DIFFERENT ITEM CATEGORIES 


Total 


Non- 
Type no. of Significant Significant 
of Item Items Items* Items Total 
Somatic 39 14 (36%) 25 (64%) 100% 
Psychic 40 9 (23%) 31 (77%) 100% 
Corrective 11 3 (27%) 8 (73%) 100% 
Subtle 27 100% 


3 (11%) 24 (89%) 


*The term “significant” denotes items in which 4 = 30 
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Fic. 2. Distribution of the 4 values in the Hs, D, and Hy scales of the MMPI for the four 


categories of items. 
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TABLE IV 
THE PROPORTION OF THE TOTAL NUMBER OF Hs, D, AND Hy ITEMS IN THE FOUR CATE- 
GORIES, COMPARED WITH THE PROPORTION OF THE SIGNIFICANT ITEMS 











Total — 





Signif. 








~ Seale Total Signif. Signif. Total 
Category Hs Scale Hs Items D Scale D Items Hy Scale Hy Items 
AES 83 (100%) 12 (100%) 11 (18%) 6 (33%) 26(48%)  10(71%) 
EE 33 (557%) 9 (50%) 9 (18%) 1 (7%) 
EEE a 11 (18%) 3 (17%) 
ee 5 (9%) 0 (0%) 25 (42%) 3 (22%) 
SS 33 (100%) 12 (100%) 60 (100%) 18 (100%) 60(100%) 14 (100%) 





How are the 29 significant items dis- 
tributed among the four item cate- 
gories? Using the frequencies given in 
Table III we obtain the following per- 
centages: 48 per cent of the significant 
items (A = 30) were somatic, 32 per 
cent psychic, 10 per cent corrective, and 
10 per cent subtle. 

Table IV presents an analysis of the 
total number of items in the four cate- 
gories, tabulated separately for the 
three scales. The 29 significant items 
were broken down in the same way. All 
of the figures have been converted to 
percentages to facilitate comparison. It 
should be remembered that some of the 
items are scored on more than one of 
the scales. It is apparent that the 100 
per cent contribution of somatic items 
to the elevation of Hs scores has no 
special significance, since all the items 
in the Hs scale are somatic complaints. 

The changes in the D scale under 
semistarvation are of particular im- 
portance for the present discussion since 
depression was the dominant feature of 
the “semistarvation neurosis”. The 
mean score on the D scale after 24 
weeks of semistarvation was 73.9, the 
highest mean elevation observed (see 
Table I). It may be noted (see Table 
IV) that the psychic items not directly 
concerned with bodily complaints con- 
stituted one-half of the significant items 
on this scale. This finding indicates that 
the elevation of the mean Depression 
score is not brought about primarily by 


an increase in somatic complaints. 


RESULTS: INDIRECT ITEM ANALYSIS BY 
COMPARISON WITH PSYCHIATRIC GROUPS 


Comparison of the percentage fre- 
quencies of abnormal answers in the 
starvation group with psychiatric 
groups should further clarify the nature 
of the personality changes which took 
place in the course of experimental 
semistarvation. Since we are interested 
primarily in items which have changed 
in semistarvation, only the significant 
items, listed in Table II, were considered 
in Table V. The figures indicate the per- 
centages of subjects in the different 
groups who answered a given item in 
the abnormal] direction. 

The similarity between the experi- 
mental subjects in the control period 
and MMPI normal males is striking. 
There are five items (A-4, C-48, F-42, 
I-27, E-3) which were answered ab- 
normally by the group at the control 
period more frequently than by the 
MMPI normal group. The excess of 
“False” answers to item A-4 (I am 
neither gaining nor losing weight) is ac- 
counted for by the attempt made during 
the control period to reduce weight in 
those men who were overweight and to 
increase the weight of those subjects 
who were below their standard weight. 
The reasons for the differences on the 
other four items are not as clear. 

Comparison of the semistarved sub- 
jects with the psychiatric criterion 
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TABLE V 


PERCENTAGE FREQU 


MMPI 
Normals 


Item Identi- 
fication 


Experimental Group 
in control period 


Somatic Items 


ENCY OF ABNORMAL RESPONSES FOR VARIOUS ITEMS OF THE MMPI* 


Experimental Group 


MMPI Abnormals after 24 weeks of 
Hs RD MD Hy semistarvation 
56 60 52 & 44 

4 4 0 3 

68 72 48 7 

68 80 97 
56 33 53 
52 52 «68 AT 88 
32 47 81 
80 63 
36 60 44 
56 60 44 
44 41 
56 87 56 
68 56 72 67 94 
60 60 69 

712 16 91 
60 48 34 
4 8 3 
16 4 37 
36 44 50 

40 «& 81 
60 76 53 

20 60 2 7: 
64 76 66 
40 44 9 
28 8 6 
24 12 6 
87 88 
73 78 
40 19 


32) during the control period with Hathaway and Me- 


Kinley’s group of 139 normal males. Also, the values for the experimental group during the 24th week of semistar- 


vation were compared with four psychiatric criterion groups (hypochondriasis—Hs, Reactive Depressior 
the number of patients was 25, 25, 25 and 15, respectively. 


A-2 11 
A-3 50 41 
A-4 14 56 
A-5 17 9 
A-16 22 9 
A-40 6 0 
A-42 8 6 
A-47 23 9 
A-55 11 13 
B-10 32 16 
B-2 18 6 
3-27 20 25 
C-17 9 3 
G-23 90 Q1 
Psychic Items 
A-24 37 38 
B-2 9 3 
B-36 18 9 
C-48 30 59 
E-41 7 9 
F-42 24 38 
F-44 16 19 
1-27 7 22 
1-37 44 34 
Corrective Items 
B-3 42 22 
B-6 16 16 
B-8 18 22 
Subtle Items 
C-42 42 59 
E-3 27 59 
F-5 35 31 
*Comparison was made of the experimental group (N = 
Depression—MD, Hysteria—Hy) ; 


groups (Hypochondriasis, Reactive De- 
pression, Manic Depression, and Hys- 
teria) reveals again a remarkable gener- 
al similarity in the percentage of the 
abnormal answers to the significant 
items. Several items were answered in 
the abnormal direction by a very large 
proportion of the experimental subjects. 
Most of these items are clearly related 
to the stress. They indicate lack of en- 


RD, Manic- 


durance (A-5), weakness (A-40), diffi- 
culty in walking (A-42), decreased ca- 
pacity for work (C-17), inability to en- 
joy vigorous recreation (E-41), and de- 
creased sex interest (C-48). Other 
closely related complaints are those of 
decreased initiative (F-42), inability to 
concentrate (1-27) and lack of confi- 
dence in one’s judgment (A-24). 

At this time it may be instructive to 
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consider answers given by the experi- 
mental subjects in a complaint invento- 
ry, specially designed for the experi- 
ment. Whereas only three per cent of 
the subjects reported at the control peri- 
od that they felt downhearted frequent- 
ly, in semistarvation the percentage in- 
creased to 62 per cent; similarly, during 
semistarvation the men complained that 
they found the experimental life a strain 
much of the time, were frequently bored 
with people, preferred to be left alone, 
and became impatient when interrupted. 
It is evident both from the Multiphasic 
results and from the complaint invento- 
ry that semistarvation resulted in defi- 
nite and pronounced personality 
changes. Such a conclusion would agree 
with the behavioral observations of the 
“semistarvation neurosis” [1, 9]. 


SUMMARY AND CONCLUSIONS 


Analysis was made of the responses 
to the items constituting the psycho- 
neurotic scales (Hypochondriasis — Hs, 
Depression — D, Hysteria —Hy) of the 
Minnesota Multiphasic Personality In- 
ventory, in order to determine the type 
of items which contributed to the ob- 
served score elevations. The Inventory 
was administered during the control 
period and after six months of semi- 
starvation. In view of the marked 
morphological and physiological changes 
in the subjects, it was felt that the con- 
tribution of somatic complaint items 
might be disproportionate. 

For purposes of analysis, the items 
on the Hs, D, and Hy scales were 
separated into four categories: somatic, 
psychic, corrective, and subtle. An item 
was considered “significant” if there 
was an increase of 30 per cent or more 
from control to semistarvation in the 
percentage of subjects who answered 
the item in the abnormal direction. 

Somatic complaint items comprised 
48 per cent of the significant items; 
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psychic items comprised 32 per cent. 
The corrective and subtle items con- 
tributed a total of 20 per cent to the 
group of significant items. An analysis 
of the clinical scales taken separately 
shows that the somatic items contribute 
most of the elevation on the Hy scale. 
On the D scale, however, 50 per cent of 
the significant items were psychic. 

An attempt was made to determine 
whether the items contributing to the 
observed score elevations in the semi- 
starved subjects are the same items 
which contribute to the elevation of 
scores in neurotic patients who had no 
physical pathology. On the whole, the 
percentage frequencies were strikingly 
similar. 

The major conclusion concerns the 
character of the psychological changes 
resulting from prolonged experimental 
semistarvation. There were no funda- 
mental differences between the kind of 
answers given by the semistarved sub- 
jects and those given by patients with a 
clinical diagnosis of psychoneurosis. 
This indicates that the semistarved men 
suffered from an actual, though tem- 
porary, personality disturbance, which 
may be described as a mild psychoneu- 
rosis. 
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MUENCH’S TESTS BEFORE AND AFTER 
NONDIRECTIVE THERAPY: 


A CONTROL GROUP FOR HIS SUBJECTS' 


By ROY M. HAMLIN AnD GEORGE W. ALBEE 


VETERANS ADMINISTRATION, PITTSBURGH, PENNSYLVANIA 
AND THE UNIVERSITY OF PITTSBURGH 


N A RECENT monograph entitled 
An Evaluation of Nondirective Psy- 
chotherapy, Muench [3] reported the 
results of an investigation of the per- 
sonality changes in a group of patients 
who had been counseled by this method. 
As one of the first rigorous, scientific at- 
tempts to evaluate the results of any 
psychotherapy, the study has stimulated 
widespread interest and discussion. Carl 
R. Rogers has described it as a pioneer 
study and suggests that its importance, 
beyond the specific findings reported, 
may derive from its demonstration of 
the efficacy of objective methods in this 
field. 

Muench pointed out the difficulty, and 
general lack of agreement, as to what 
constitutes a psychological recovery, and 
the dearth of clear-cut, acceptable cri- 
teria of cure. It is apparent that there 
may be a difference between sympto- 
matic recovery and actual changes in 
the personality structure. In using a bat- 
tery of diagnostic psychological tests 
consisting of the Bell Adjustment In- 
ventory, the Kent-Rosanoff Free As- 
sociation Test, and the Rorschach, 
which was administered before the be- 
ginning and at the conclusion of psy- 
chotherapy, Dr. Muench attempted a 
precise, quantitative, and operational 
meaning of what constitutes psychologi- 


1Published with the permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 
sumes no responsibility for the opinions ex- 
pressed nor conclusions drawn by the author. 


cal recovery. Rather than depending up- 
on subjective estimates of recovery, or 
taking what the client says about him- 
self as the criteria of change, he sug- 
gested that “the best method of evalu- 
ating the success of psychotherapy 
would be based on the degree of growth 
and development which has occurred, 
expressed in terms of how much more 
emotionally mature and _ intellectually 
integrated the client is at the termi- 
nation of treatment than at the outset 
of treatment. It seems... . that some 
means must be established whereby we 
can accurately gauge the degree of psy- 


‘chological growth which has been de- 


veloped during psychotherapy, and 
eventually ascertain how effective are 
those changes which occur during psy- 
chotherapy in terms of the individual’s 
long range adjustment.” 

In applying a consistent method 
of treatment to his data, Dr. Muench 
demonstrated statistically significant 
changes on each of his tests for the 
group of clients who had experienced 
nondirective psychotherapy. From the 
results of his study, he concluded that 
a change occurs in the basic personality 
structure in certain cases of nondirec- 
tive psychotherapy, and he showed that 
a general improvement was evident in 
ten of the twelve cases. 


PROBLEM 


The authors were impressed by the 
findings which Muench reported and felt 
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A CONTROL GROUP FOR MUENCH’S SUBJECTS 


that an attempt at a form of control 
study might be valuable for several 
reasons. First, it was possible that 
Muench’s subjects were at the “peak” 
of a conflict at the time of their first 
testing since they had, at that particular 
time, sought psychological help, and the 
changes evident on the second test 
might, therefore, have been a spontane- 
ous regression toward less acute malad- 
justment. Second, mere repetition of the 
tests might affect the specific ratings 
Muench used, which on the Rorschach 
were discrete quantifiable factors, 
rather than the ‘global’ approach ad- 
vocated by most authorities on this test. 
Also, there was the possibility that with 
a second experience with a test battery, 
the subjects might be more confident 
and less anxious because of increased 
familiarity with the situation, and that 
this change in attitude might be reflect- 
ed in test performance. 

Finally, in choosing subjects, the 
authors felt it might be possible to check 
Muench’s suggestion that mere verbal 
expression by clients of improved adjust- 
ment did not necessarily reflect changes 
in basic personality structure. 


PROCEDURE 


As a control group, in general com- 
parable to Muench’s experimental 
group, subjects were taken from two 
classes in abnormal psychology. One of 
these classes was composed chiefly of un- 
dergraduates at the University of Pitts- 
burgh, and the other was an evening 
section made up principally of individu- 
als regularly employed who were taking 
the course out of general interest in the 
subject. Muench’s group was composed 
of subjects who came to a University 
Psychological Clinic and was made up 
principally of students and employed 
persons of superior educational experi- 
enee. 

At the first class session of the year, 
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these two classes were given the Bell 
Adjustment Inventory [1]. They were 
told that an experiment was being con- 
ducted to determine the effect upon 
personal adjustment of a course in ab- 
normal psychology, and that some of 
them might be asked to take another in- 
dividal test before and after the semes- 
ter. The Bell was scored, and those in- 
dividuals obtaining the highest (poor- 
est) Total Adjustment scores were ask- 
ed at the end of the next class session 
if they would assist in the experiment 
described in the first class meeting. Of 
the nineteen subjects, all agreed to serve 
in the experiment. During the semester, 
three of these subjects left school so that 
the study was concluded with sixteen 
subjects. At the end of the semester, the 
Bell was again administered to both 
classes, and the sixteen subjects of the 
original “maladjusted” group were re- 
tested with the Rorschach. 

The sixteen subjects showed close 
similarity to Muench’s group. A differ- 
ence of two years in mean age is not 
statistically significant, and the ratio of 
males to females was approximately the 
same. The groups showed comparable 
educational level with about the same 
distributions of employed persons and 
undergraduate students. The willing- 
ness of the subjects in the control group 
to admit of dissatisfactions and emo- 
tional problems in answer to questions 
in the Bell may be considered somewhat 
analogous to the admission of problems 
requiring professional assistance on the 
part of the experimental group. Further 
confirmation of this assumption is evi- 
dent when the two groups are compared 
in terms of unsatisfactory Rorschach 
signs on the first test. There was no 
significant difference between the 
groups when original Rorschachs were 
compared. 

The Rorschach protocols were scored, 
using the system of analysis employed 





414 


by Muench, and checked independently 
by two examiners. Two of the twenty- 
two factors examined by Muench were 
not used because the procedure was not 
entirely clear to the authors. The two 
factors not used were “personal adjust- 
ment patterns” 4 and 7. Inspection of 
Muench’s [3, p. 154, Table XLIV] re- 
sults indicates that these factors did not 
contribute to the improvement in 
Muench’s group. Distributions showing 
personal, social and total adjustment 
factors, together with the changes in 
these factors, were utilized to give sta- 
tistical measures of the significance of 
changes, which would be directly com- 
parable to Muench’s results. 

The treatment of Bell scores used by 
Muench was followed so that direct 
comparison of changes from pretest to 
end-test might be possible between the 
control group and Muench’s group. Lit- 
tle weight was given to Bell score com- 
parisons since the control subjects were 
selected on the basis of Bell scores. 
However, to check on whether only the 
extreme subjects changed or whether 
the total classes changed, an exami- 
nation of the differences for the total 
group of students in both classes was 
made. 


RESULTS 


Our group of “maladjusted” subjects 
who had received no psychotherapy 
showed marked improvement on the 
Bell Adjustment Inventory when retest- 
ed after five months. The change in total 
adjustment was significant at the one 
percent level of confidence. The greater 
improvement of our group over 
Muench’s is shown in Table I. The Mean 
improvement in each of the Bell factors, 
for Muench’s group and our no-therapy 
group, is shown in the columns. Critical 
ratios for their improvements are listed 
for the group who had nondirective 
therapy, and for our no-therapy group. 
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TABLE I 
COMPARISON OF BELL ADJUSTMENT FACTORS 
BEFORE AND AFTER INTERVAL 

















a 
-- 
e Ss 
Bell aa: 2 oe ee oe 
Factor Ch Sh Za Pe Sa 38 
2 $2 sh fe 32 Se 
Te ta ok me Om BA 
Therapy group 
Meanimprovement .25 2.33 58 3.67 2.60 17.92 
No-therapy group 
Mean improvement 3.90 2.60 3.10 3.87 3.67 17.00 
Therapy group “‘t”’ 15 3.14 50 2.03 1.44 1.87* 
No-therapy 
group “‘t”’ 2.256 3.94 3.30 2.71 8.63  4.30** 
*P: = .09 
**Pr = .01 


On the Rorschach, our group showed 
no statistically significant changes from 
test to retest in satisfactory signs of 
personality adjustment. The contrast be- 
tween our group and the group who had 
experienced nondirective therapy is 
shown in Table II. Where Muench found 
changes in his group significant at the 
one percent level, our no-therapy group 
showed no statistically significant 
change. 


TABLE II 
COMPARISON OF SATISFACTORY RORSCHACH 
SIGNS OF ADJUSTMENT BEFORE 
AND AFTER INTERVAL 





Personal Social Total 
Pre End E-P Pre End E-P Pre End E-P 








Therapy 
group 


Mean 6.08 8.08 2.00 6.33 8.00 1.67 12.41 16.08 3.67 


No-therapy 
group 
Mean 


6.44 5.63 .19 5.69 5.94 .25 11.12 11.56 .44 


Therapy 


group “‘t’”’ 3.31 2.95 4.88* 


No-therapy 


group “‘t”’ -56 -54 -85** 








*P; =.01 
**P; = .40 


An examination of the tendencies 
toward improvement and decrement in 
Rorschach signs of adjustment showed 
that the group who had received no 
therapy made no statistically significant 
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changes, although there was a consistent 
trend in the direction of improvement. 
A comparison of these factors in both 
groups is possible in Table LII. This 
table lists the direction of change in the 
factors examined, whether or not the 
original factor was satisfactory or un- 
satisfactory. 


TABLE III 
COMPARISON OF IMPROVEMENT AND DECREMENT 
IN RORSCHACH SIGNS OF ADJUSTMENT 
BEFORE AND AFTER INTERVAL 


Personal Social _ “Total 
Imp. Decr. I-D Imp. Deer. I-P Imp. Deer. I-P 











Therapy 
group 
Mean 4.67 

No-therapy 
group 
Mean 3.25 


2.58 2.09 5.76 2.25 3.6010.41 4.83 5.58 


8.13 .12 4.88 3.00 1.387 7.63 6.13 1.50 
Therapy 

group “‘t”’ 
No-therapy 


group “‘t”’ 17 1.23 


2.48 3.77 





*Pr= .01 
**P; = .85 


Muench pointed out that of his twelve 
cases, four were considered by the 
therapist to have been successful while 
the remaining eight were believed less 
successful. He compared these successful 
cases with the less successful cases in 
terms of Rorschach signs of adjustment. 
Table IV shows his findings and shows 
how our no-therapy group compares 
with his groups. The trend of improve- 


TABLE IV 
COMPARISON OF IMPROVEMENT IN RORSCHACH 
SIGNS OF ADJUSTMENT BETWEEN SUCCESS- 
FUL CASES AND LEss SUCCESSFUL CASES 
AND No-TREATMENT CASES 











Mean 
Im- 
Num- prove- 
ber ment t Pt ti,2-s Pe 
Successful Cases 4 12.00 
1.7337 12 
Less Successful 
Cases 8 9.63 
1.3514 .20 
Notherapy Cases 16 7.63 2.2787 .04 
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ment from Successful, to Less-Success- 
ful, to No-Treatment groups shows a 
consistent decrement. 


DISCUSSION 


In comparing the test-retest perform- 
ance of a group of subjects who were 
originally selected on the basis of ex- 
pressed dissatisfaction, as reflected by 
the Bell, with a group of clients who had 
experienced nondirective therapy, it has 
been demonstrated that while the thera- 
py group showed statistically significant 
changes on both the Bell and the 
Rorschach, the no-therapy group 
showed significant changes only on the 
Bell. 


One explanation for the marked 
change in adjustment indicated by the 
Bell might be that the subjects obtained 
high maladjustment scores on the first 
test due to transient or situational fac- 
tors, and that the regression toward 
more satisfactory adjustment was due 
to such chance factors. In order to check 
this possibility, the significance of 
changes from test to retest for the 
entire group of individuals in the two 
abnormal psychology classes was deter- 
mined and found to be statistically sig- 
nificant at the one percent level. It seems 
that a reasonable explanation for these 
changes might be that after taking a 
course which emphasized symptoma- 
tology and dynamic mechanisms, all 
students were less willing to admit to 
symptoms of maladjustment. At the 
same time, since the students believed 
the purpose of the test was to determine 
the effect of a course in abnormal psy- 
chology, they were inclined perhaps to 
do what they could to assure their in- 
structor of positive results. Having no 
knowledge of the Rorschach, it was im- 
possible for the subjects to do anything 
to influence the pattern of factors 
studied by this test, and therefore, we 
find no significant changes in “basic 
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personality structure,” despite their 
subjective expression of less disturb- 
ance. 

These findings appear to support sev- 
eral of the implications of Muench’s mon- 
ograph. By using as a control, a group 
of subjects comparable to his in age, 
sex, education, and adjustment prob- 
lems, it has been demonstrated that 
significant changes in personality struc- 
ture accompany the experience of non- 
directive therapy and are not associated 
with the passage of time, even though 
during that interval the subjects im- 
prove in their subjective admission of 
problems. Muench’s criticism of the cur- 
rent effort to evaluate the results of 
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therapy in terms of what the client says 
at the conclusion of treatment, and his 
suggestion that changed verbalizations 
may reflect only symptomatic or social 
recovery are both supported by the 
present study. 
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THE ROLE OF THE SOCIAL FIELD IN PSYCHOTHERAPY’ 
By ABRAHAM S. LUCHINS 


MENTAL HYGIENE SERVICE, NEW YORK REGIONAL OFFICE 
VETERANS ADMINISTRATION 


ONTEMPORARY psychotherapy 

—whether directive or nondirect- 
ive, analytic or nonanalytic, administer- 
ed in individual or group sessions—usu- 
ally centers on the dynamics of the in- 
dividual and on the creation of changes 
in the individual, rather than on the dy- 
namics of the social] field and on the ma- 
nipulation of this field for therapeutic 
purposes. It may attempt to produce 
clarification or “inner strength” in the 
patient (by means of catharsis, insight, 
spontaneity-training, the development 
of frustration-tolerance, etc.), so that 
he is better able to understand himself 
and his disorders, and to adjust to (and 
perhaps manipulate) environmental 
conditions. The individual is the vari- 
able to be manipulated. The social norms 
and artifacts outside of the clinic or 
hospital are regarded more or less as 
constants. Such therapy may be suited 
for those individuals whose emotional 
difficulties are due to internal factors, 
but is it suited for those whose diffi- 
culties are brought about in the main by 
outer circumstances? The underlying 
problems were recently well formulated 
by Cantril [2]. 


Since personal conflicts are so often due to 
conflicts in the objective situations themselves, 
it is obvious that unless conflicts existing in 
the objective groupings an individual identifies 
himself with can be resolved, the individual 


1Published with permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 


has little chance of resolving his own “inner” 
conflicts. 

. .. While it can readily be admitted that 
the insight gained in either a directed or “non- 
directed” psychotherapy may serve as a neces- 
sary prelude to show some people what has to 
be done in the way of rearranging the objec- 
tive conditions they face if they are to regain 
mental health and composure, it is a cruel illu- 
sion for a layman to be allowed to entertain 
the thought that “insight” through psycho- 
therapy is in itself the answer to his troubles. 
Indeed, this insight may often only show him 
that his troubles are bigger than he himself 
thought they were and cannot be solved until 
basic changes occur in the social structure. 
Hence, it may well be that under social condi- 
tions where objective circumstances make the 
resolution of many personal conflicts difficult,” 
the insight gained by psychotherapy may ac- 
tually pile up visceral tensions etc., by increas- 
ing a person’s sense of futility concerning an 
effective course of action. This is not meant 
as a criticism of all psychotherapy as such. 
Nor are we forgetting the value expert clini- 
cal help can have for those individuals whose 
difficulties may stem from their own unique 
temperamental or other personality character- 
istics almost irrespective of their social milieu. 
But we do mean to criticize any brand of psy- 
chotherapy that, in actual concrete practice, is 
blind to the role of conflicting, contradictory 
conditions that often obtain outside the indi- 
vidual on the stimulus side and create conflicts 
and dilemmas within him.’ [2, pp. 50-51] 


To be sure, it is becoming increasing- 
ly recognized, as Murphy [10] points 
out, that the therapeutic session “is on- 


2See, for example, [6] which indicates how 
community disorganization and contradictions 
in the social structure may give rise to some 
aspects of the phenomenon of adolescence. 


8The author’s attempt to present to and dis- 


sumes no responsibility for the opinions ex- cuss with patients the role and function of 
pressed or the poco Oh drawn by this au- some of the social factors that might give rise 
thor. to mental illness are described in [6]. 
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ly one kind of situation, and it does not 
necessarily prevent the patient’s sub- 
sequent failure when he confronts the 
other situations of which his life is com- 
prised.” [10, p. 885] Murphy continues: 


For this reason psychiatry is making more 
and more use of situational therapy. . . The 
psychiatrist who wishes to see the whole per- 
sonality must see the patient in all the situa- 
tions of his life; indeed, he must place him in 
countless new situations to bring out new as- 
pects of his personality. The group therapist 
often succeeds in shortening this almost in- 
finite process because many of the patient’s 
critical maladjustments appear in group situa- 
tions, and it is precisely in the group situa- 
tion that the diagnosis and therapy are carried 
on, [10, p. 885] 


It has been our experience, however, 
that even in group therapy, one cannot 
begin to place the patient ‘“‘in all the 
situations of his life,”’ one cannot hope 
to duplicate the complex life-pattern of 
the patient, nor expect transfer of the 
role he plays in the group and in group- 
enacted situations to his existence out- 
side of the group sessions. The very 
nature of these sessions, the confines of 
the meeting place, the artificiality of en- 
acted situations, the varied personalities 
and experiences of the members, and 
the exigencies of the present and future, 
make it difficult even to approximate 
many of the situations which the pa- 
tient has experienced or will face, par- 
ticularly if he is not confined to an in- 
stitution with its relatively controlled 
and restricted environment. To cite a 
case in point: We found that our group 
therapy program, aimed at dealing with 
the everyday problems and social ad- 
justments of the members, appeared to 
be more effective for patients of army 
mental hospitals [6, 7, 8] than for pa- 
tients of a Veterans Administration 
Mental Hygiene Clinic [9]. The hospital 
world offered opportunities for direct 
application of what was learned in the 
group sessions. Group therapy helped 


some patients to adjust to the closed 
ward, prepared them for the open ward, 
and helped them once they reached the 
latter ward. The goals were more ap- 
parent to the hospital patients. Adjust- 
ment in the closed ward led to transfer 
to the open ward; and adjustment there, 
to wider opportunities for freedom to 
indulge in various types of activities. 
Unlike hospitalized patients, the 
clinic’s patients lived at home, usually 
with parents and wives in crowded 
quarters, traveled in crowded subways, 
and often had to work not only for their 
own livelihood but for the support of 
their families. Daily, they faced the hur- 
ry and bustle, the competition and com- 
plexities of life in New York City. Ac- 
tive participation in group therapy and 
even apparent insight into their diffi- 
culties did not necessarily lead to ad- 
justment in the life outside of the clinic. 
(True, during the Christmas season 
most of our patients made a vocational 
adjustment, since the demand for work- 
ing people at that time permitted them 
to obtain positions, principally as postal 
clerks and as salesmen in department 
stores; but after the holiday rush, their 
services were no longer required, their 
records of mental illness again disquali- 
fications for the securement of gainful 
employment.) Patients might square 
their shoulders as they entered the room 
in which the group meetings were held, 
and become important personages, with 
definite status in the group. However, 
when they left and shuffled their way 
through the crowd and the traffic, to re- 
sume their unhappy, unsatisfying exist- 
ences, some again felt themselves to be, 
as one of our patients expressed it, “use- 
less, unwanted, insane pensioneers.” In 
brief, the hospital’s environment was 
simpler, more subject to manipulation, 
control and prediction for therapeutic 
purposes than was the complex world 
facing the clinic’s patients, so that the 
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latter might understandably manifest 
less transfer from therapeutic sessions 
to situations outside of the clinic. 

It was our impression that the least 
transfer usually occurred in the case of 
(1) those whose main cause of conflict 
lay in objective circumstances over 
which they had little control, and (2) 
those individuals, best described as in- 
adequate personalities, who were unable 
to cope with the complexities, compe- 
tition, and aggressiveness of the outside 
world. On the other hand, the largest 
carryover seemed to take place for those 
patients who had a number of social 
contacts outside of the clinic, with fair- 
ly stable, secure membership ties (in a 
family, church, business or social or- 
ganization) which could be manipulated 
by the therapist for therapeutic effects. 
Similarly, staff members of the Veter- 
ans’ Rehabilitation Clinic of Mount Zion 
Hospital, San Francisco, found that 
where “there was no stability in at least 
one area of the veterans’ environment 
— his home, his job, his friends — re- 
habilitation became extremely difficult.” 
[4, p. 266] Such observations emphasize 
the role played in the determination of 
the efficacy of therapy by group-belong- 
ingness and by general social field con- 
ditions. 

What can the therapist do to aid pa- 
tients in the first and second categories 
above, and those who do not have 
stability in important aspects of their 
environment? We believe that he must 
be ready to take into active account the 
roles played by social field conditions in 
producing normal personalities and in 
creating, prolonging, and aggravating 
personality disturbances and also, the 
potentialities field conditions possess for 
the treatment of such disturbances. 
These are indeed implications that stem 
from the generally accepted theory that 
the personality is a biosocial product. If 
he holds this theory, the therapist ought 


not to regard his patient as an organism 
qua organism in isolation from its field, 
but should attempt to discover what 
roles social field conditions have played 
and are playing in the development of 
this particular personality constellation, 
and how he can best utilize social forces 
to produce changes in the personality in 
the direction of better mental health.‘ 
In order to function effectively the 
therapist must not only venture out in- 
to the community to study, guide and 
encourage a particular patient in his 
actual milieu, but must attempt to ef- 
fect changes in the community in order 
to create a social atmosphere conducive 
to mental health for the entire com- 
munity. There is a need to broaden our 
concept of psychotherapy to include 
treating the entire community. It is only 
then that we will be able to have the as- 
surance, when we send a patient out in- 
to the world, that he is going out into a 
world in which he can function. A step 
in this direction can be made by the 
therapist engaging in action research 
and utilizing action techniques. 

Action research and techniques, usu- 
ally associated with the late Kurt Lew- 
in and his students, are of various types, 
all of which have in common their con- 
cern with problems which arise directly 
out of community life and community 
needs, and their utilization in the actual 
community setting, after the problems 
have been so formulated as to make 
them susceptible to investigation in this 
setting [3, p. 43]. They are particularly 
suited for the scientist “who wishes to 
pursue a scientific way of life and at the 


‘True, in contemporary psychotherapeutic 
theory, and even in psychoanalytic theory, the 
organism is seen in relation to society, but the 
nature of the relationship is often that of a 
clash or struggle of opposing tendencies in 
which society is regarded as a series of ob- 
stacles to man’s gratification. Adherence to 
such a view, with its dichotomy between man 
and society, may cause one to neglect the posi- 
tive values of social forces in permitting and 
enhancing the organism’s development. 
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same time to devote his energies toward 
civic betterment,” who is interested not 
only in making discoveries but in the 
proper application of these discoveries 
[8, p. 43]. Action programs have been 
used for various purposes, e.g., studying 
and attempting to change food prefer- 
ences [5], studying and attempting to 
combat racial prejudices [cf. 3]. We 
propose the application of these meth- 
ods to the creation of interpersonal re- 
lations conducive to mental health and 
for the development of group action to 
find places in the community for mental 
patients, where they can serve in a 
productive capacity and become integral 
members of the community. 


A PROPOSED PSYCHOTHERAPEUTIC ACTION 
PROGRAM 


For a psychotherapeutic action pro- 
gram to be effective, it must be the joint 
undertaking of psychiatric, psychologi- 
cal, educational, and social science or- 
ganizations (of clinical personnel, social 
psychologists, sociologists, educators, 
ethnologists and others who have expe- 
rience in community organization and 
planning), and of responsible lay mem- 
bers of the community. We envision the 
program conducted on a national scale, 
and adapted and supplemented in in- 
dividual communities in accordance 
with their particular conditions and re- 
quirements. 

First, both in particular communities 
and on a broader scale, research is called 
for to determine (1) which social field 
conditions are conducive to mental 
health and which are conducive to the 
production and continuance of person- 
ality disturbances, and (2) what can be 
done to mitigate such effects or to pre- 
vent such situations from arising. 

Second, it is necessary to survey pos- 
sibilities of utilizing some of the mental- 
ly ill in some socially acceptable and pro- 
ductive capacity. As certain agents in 
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the business world seek profitable ways 
of utilizing the waste products of manu- 
facturing processes, and even create 
needs for them where none exists, so 
those engaged in a psychotherapeutic 
action program will be charged with the 
responsibility of rehabilitating our crip- 
pled personalities, will seek to find, and 
if need be, create places and functions 
for them. 

Third, there must be an intensive 
educational program for the public. In 
spite of the good work done by various 
mental hygiene organizations, the pub- 
lic still maintains a host of miscon- 
ceptions concerning mental illness. It is 
regarded as a strange, bizarre phenome- 
non, the resultant of an unfortunate pro- 
pensity in the individual or even in the 
entire family. Families with a mentally 
ill member suffer agonies of personal 
and social disgrace. Employment and 
normal social intercourse is often impos- 
sible for one known to have been in a 
mental institution. While there is in- 
tense interest in the subject, it is being 
exploited by many moving pictures, pop- 
ular publications, and radio programs— 
with their emphasis on violent psychoses 
or highly emotional neuroses, and on the 
dramatic, erotic aspects of psychoanaly- 
sis. It is fashionable to mouth watered- 
down analytic concepts, to worry about 
the drama of love and hate in an in- 
dividual or in a family, to be concerned 
with sexual behavior in early childhood 
days, and to talk about visiting an 
analyist. On the whole, the public re- 
mains woefully ignorant of the fre- 
quency, nature, cause and susceptibility 
to treatment of various mental dis- 
orders, and, above all, of the social con- 
ditions of daily life which help to pro- 
duce such disorders, of the role played, 
for example, by the conflicting teach- 
ings and demands of various institu- 
tions of which an individual is a member 
(say, family versus business versus 
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church); by the emphasis on success 
and competition in our schools, busi- 
ness, and social organizations; by racial, 
national, and religious prejudices; by 
specific “cultural lags’; and by the 
general coldness and indifference fre- 
quently manifested in daily interperson- 
al relations. 

What we propose, therefore, is a pro- 
gram aimed at informing the public (1) 
of the frequency, variety, and nature of 
personality disturbances, (2) of the 
social conditions of daily life which are 
conducive to such disturbances, (3) that 
not all of the mentally ill need be in 
institutions, and that both in institu- 
tions and in the regular communities 
there is a possibility of some of these 
individuals serving in productive capaci- 
ties, and (4) that they, the public, can 
actively participate in their own com- 
munities in the prevention and treat- 
ment of mental illness. 

We envision the hub of the psycho- 
therapeutic action program as a com- 
munity-centered, action-orientated men- 
tal hygiene clinic, whose aims will be 
prevention of personality disorders, ed- 
ucation of the public, treatment and re- 
habilitation of those mentally ill in- 
dividuals living in, or near, the com- 
munity who are not so disturbed that 
they require institutionalization. We 
have advisedly placed the action re- 
search in the clinic instead of creating 
another institution. The network of in- 
stitutions at present dealing with the 
patient is so complex in organization 
that even a normal individual might be- 
come confused as he is sent through the 
maze of clerks, interviewers, testers, 
therapists, and personnel of allied serv- 
ices. The purpose of action research 
and action techniques is to create a 
simple world for these patients; to set 
up another institution is to add to the 
complexity. 

It might not be out of place to 


mention that we believe that many of 
the functions at present being perform- 
ed by separate and relatively independ- 
ent institutions should be brought into 
the clinic. A community-centered clinic 
should incorporate, for example, such 
functions as educational and vocational 
advisement, placement service and 
social service. To send the patient to 
outside agencies may actually aggravate 
his problems since the various institu- 
tions, because of their particular needs, 
may develop diversified administrative 
policies which, while expedient for them 
[cf. 1] are not best from the point of 
view of the total treatment of the pa- 
tient. Moreover, to take an already con- 
fused, possibly rather rigid individual, 
and to send him to one place for vo- 
cational advisement, to another for ed- 
ucational guidance, and to a third for 
some other service, may be to confront 
him with a confusing, overcomplex 
situation. Coordination of such func- 
tions within the clinic itself, under a 
single administrative policy, may oper- 
ate against this feeling of bewilderment, 
and may permit better integration of 
the various functions in the direction of 
unified therapeutic aim. 

Since the clinic will have some control 
over the outside world, the patient will 
be able to be placed in situations which 
may create in him the necessary per- 
sonality structure and need for optimum 
functioning in the community. In short, 
we consider the possibility of bringing 
about changes in behavior by changing 
the patient’s life situations. If the bio- 
social approach to personality is valid, 
it should be possible to structure the pa- 
tient’s social field to produce a desired 
response. It may not be out of place to 
add that te wait for the patient himself 
to manifest a desire for action because 
of inner growth — perhaps on the 
grounds that only then can it have 
meaning for him — may not be advis- 
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able in many cases. (In our experience, 
patients have often viewed the thera- 
pist’s waiting for them to be ready to 
act as justification for ‘remaining idle, 
for waiting for the day when the revel- 
ation will strike them and relieve their 
emotional blocks. In this connection, we 
might borrow a page from the history 
of education on the subject of readiness, 
and recognize the dangers involved in 
delaying action until the individual 
manifests “readiness” for it.) 

As at present, staff members will 
study the patient’s home conditions, at- 
tempt to give members of the family 
some understanding of the patient’s 
problems and to secure their attendance 
at classes held by the clinic, or if neces- 
sary, to arrange for therapeutic treat- 
ment for some of them; and they will 
strive to enlist the cooperation of the 
family in establishing home conditions 
more favorable to the patient’s treat- 
ment and rehabilitation. In addition, 
forums on topics of psychology and a 
group therapy program will be main- 
tained by the clinic, not only for the pa- 
tient’s kin, but also for the general pub- 
lic. It may be advisable to open these 
activities to groups composed of both 
patients and nonpatients, especially 
businessmen, educators and religious 
leaders, in order to achieve better mutu- 
al understanding. . 

The clinic will attempt to enlist the 
cooperation of various social-planning 
agencies, of the community’s schools, 
business institutions; social, recreation- 
al, and religious organizations, and to 
play an active role in coordinating their 
activities for therapeutic purposes, so 
that they will work along with the clinic 
in creating conditions favorable for 
mental health, and in making room for 
patients who will be brought to them by 
clinical personnel, and guided and 
supervised by the latter while partici- 
pating in the institution’s activities. For 
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example, a survey will be made of avail- 
able jobs and the employers told that 
certain patients will be carefully select- 
ed for them on the basis of their mental 
and physical condition and their pre- 
vious employment, that they will be 
given training if necessary, and that 
while they are on the job, daily check- 
ups will be made by clinical personnel ; 
moreover, they will be told that working 
on a job, even in a limited capacity, may 
help the individual to adjust and keep 
him out of a public institution, thus 
saving money for the employer and 
other taxpayers. Religious, social and 
recreational groups will be made aware 
of their potential importance in con- 
structing a world for the patient, and 
that comparatively little danger is in- 
volved in admitting into their organi- 
zations patients carefully culled for this 
function by the clinic and _ initially 
supervised while in the group. Thus 
supported by the clinic, the patient will 
venture into the world and bring back 
to the clinic for discussion and analysis, 
in individual or group sessions, his prob- 
lems in the world of daily life until he 
is ready to venture out on his own. 

In brief, the clinic will study and 
mobilize existing forces in the communi- 
ty, will introduce new factors if neces- 
sary, and serve as a clearing house in 
which opportunities for action are 
matched with the needs of the patient, 
in order to help ameliorate some of the 
sources of conflict troubling the in- 
dividuals, to strengthen and produce 
social ties, to help create for the patient 
a world in which he can function at his 
optimum level, and to give him, in ad- 
dition to verbal support, a supportive 
world in place of the behavorial world 
of his illness. 

For those individuals who are not 
ready to reside or work in the usual 
community, we envision protective 
workshops and sheltered communities. 
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Such institutions have been maintained 
in some European countries, e.g., Eng- 
land, and investigation is certainly 
called for to determine their past ac- 
complishments and their potentialities. 
It seems to us that such workshops and 
restricted communities tend to isolate 
and ostracize the patient, unless they 
are included in a broader action pro- 
gram, in which they are used by the 
community clinic as training centers 
for employment and socialization of pa- 
tients, and are regarded by patients and 
others as stepping stones for advance- 
ment to wider circles of activity and 
social responsibility until the patient is 
prepared to take his place in the regular 
community. 


SOME CRITIQUES OF ACTION 
PSYCHOTHERAPY 


Our ideas concerning action psycho- 
therapy have emerged, clarified, and 
been altered as a result of frequent dis- 
cussions with members of the Veterans 
Administration Clinic, and with other 
members of the psychiatric and psycho- 
logical professions. In the course of such 
discussions, several criticisms of the 
program have been reiterated. In the 
main, they are the following. 

1. Study and manipulation of the 
social field is the function of social 
workers. Perhaps theoretically this is 
their task, but many social workers of 
our acquaintance are interested prima- 
rily in dealing with personality malad- 
justments of a particular patient or 
members of his family, usually by analy- 
tic or nondirective techniques. More- 
over, they seldom can reach beyond the 
immediate family constellation and can- 
not, unaided, cope with the numerous 
social forces and institutions which af- 
fect, or can be made to affect, the pa- 
tient. Certainly there is a decided need 
for social workers in action psycho- 
therapy but the entire task of active 
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field work in the, community must not 
be placed on their shoulders. Psychia- 
trists, psychologists, and all other clini- 
cal personnel must be ready to study 
and work in the community at first 
hand, in order most effectively to help 
patients to function at their optimum 
level as socially productive members of 
their communities. 

2. Action psychotherapy cannot re- 
place the usual individual and group psy- 
chotherapy. Indeed, it cannot; nor was 
it intended to imply that it would. What 
we are hoping is that when confronted 
with a patient who requires action psy- 
chotherapy, private practitioners will 
utilize such therapy as a supplement to 
their usual procedure, or will refer the 
patient to the nearest clinic which can 
provide such supplementation. And in 
the clinic itself, customary individual 
and group psychotherapeutic procedures 
will be available for those individuals 
who can benefit from them. Moreover, 
if a patient’s maladjustment is of such 
a nature that it can be treated solely by 
customary therapy, he will not be re- 
quired to participate in the other activi- 
ties of the clinic. In action psychothera- 
py, the pathogenic factors in the com- 
munity will be treated as well as the in- 
dividual patients and their particular 
life situations. Because of this, it may 
be of benefit even for those patients for 
whom customary individual therapy will 
be utilized. Action research and action 
techniques are not intended to supplant 
individual psychotherapy but to create 
an atmosphere in which the latter can 
function more effectively. 

3. Action psychotherapy increases 
the danger of developing dependence of 
the patient on clinical personnel. While 
it is true that this therapy may in some 
cases continue the dependence for a 
greater period of time than do tradition- 
al procedures, this will be justified if in 
the long run the patient is better able 
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to function in the outside world, if the 
guiding hand he received while walking 
out into the world gave him the neces- 
sary strength to walk by himself. An 
important aim of action therapy is the 
development of conditions in which the 
patient can gradually acquire those 
habits and skills necessary for intelli- 
gent, independent action. For this 
reason, the support given to a patient 
will be decreased if and as he shows his 
ability to do without it. In the case of 
some individuals, the period of depend- 
ency on clinical personnel may even be 
decidedly shorter than if customary 
therapy were employed because of the 
stress that action therapy places on the 
creation and strengthening of varied 
social ties. 

It is of course conceivable that some 
patients will permanently be dependent 
on clinical personnel to some extent, but 
there is no reason to believe that they 
would have fared better if no attempt 
had been made to help them by means 
of action therapy. Indeed, we believe 
that there is nothing inherently wrong 
in dependence, as such, if it permits the 
individual to function more capably and 
more productively. So much ado has 
been made about dependency that one 
is inclined to think some of the shout- 
ing is due to the reluctance of some 
clinical personnel to assume responsi- 
bility for the patient. Perhaps it is time- 
ly to reevaluate this concept, not only 
in therapy, but in our society as a whole, 
since ours is a world of interdependence 
in which no man can really live alone. 

4. The expenses involved in estab- 
lishing and maintaining action clinics, 
protective workshops, and _ sheltered 
communities, are so prohibitive as to 
make these undertakings unrealistic. 
Compared to the huge sums of money 
the local governments and private 
citizens spend annually on clinics, sana- 
toriums, and mental hospitals, and the 


sums spent by the federal government 
on veterans discharged because of 
neuropsychiatric reasons, the construct- 
ive agencies required in action therapy 
may be relatively inexpensive. And by 
what monetary standard shall one gauge 
the value of the preventive and rehabili- 
tation aspects of these agencies, the 
roles they may play in keeping individu- 
als out of mental institutions, and of 
helping some who might otherwise be 
burdens on their families or govern- 
ments to function in a productive 
capacity? 

5. Until drastic reorganizations oc- 
cur in our socio-economic setup, it is im- 
possible to introduce effective action 
therapy. To be sure, we cannot create 
personal utopias for each patient. How- 
ever, even under present conditions 
much can be done to eliminate some of 
the sources of objective conflicts creat- 
ing emotional disturbances, to attempt 
to change attitudes and to teach people 
so that conditions more favorable for 
mental health are created, and to utilize 
action research and therapy to make 
some gains in the direction of more ef- 
fective prevention, treatment and re- 
habilitation. To do so, we reiterate, calls 
for active cooperation among the psy- 
chiatric, psychological, and social sci- 
ence organizations — among clinical 
personnel, social psychologists, educa- 
tors, ethnologists, and others who have 
experience in organizing a community 
for action. 


A NOTE TO PSYCHOLOGISTS 


We regard action psychotherapy as a 
particularly fertile field of exploration 
for clinical psychologists in which they 
can utilize their training in social psy- 
chology, experimental psychology, and 
the social sciences. Moreover, here is an 
opportunity to test experimentally the 
actual outcomes of therapy in the world 
outside of the therapeutic chambers 
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(the world for which we are theoretical- 
ly preparing the patient), to determine 
the efficacy of therapeutic procedures 
and the amount of carryover from 
therapeutic sessions. Certainly social 
psychologists interested in action re- 
search should find stimulating and chal- 
lenging the problems of organizing and 
conducting such research for thera- 
peutic purposes. 

What was described herein con- 
stitutes but a general sketch of our con- 
ception of what may be accomplished 
by action psychotherapy. Many possible 
aspects — for example, the organization 
of mental institutions in accordance 
with the principles of action research 
and techniques — have not been dealt 
with at all. In most cases our sug- 
gestions are not sufficiently concrete to 
permit their immediate application. In 
order that more detailed, workable plans 
be established, we propose as an initial 
step the setting up of a committee com- 
posed of representatives of the Division 
of Clinical and Abnormal Psychology 
and of SPSSI, which will cooperate with 
other divisions and with representatives 
of the psychiatric profession. After pre- 
liminary spade work by such a commit- 
tee, it may be possible to obtain funds, 
perhaps from the United States Public 
Health Service, to initiate the action re- 
search, education, and therapeutic 
action program in an actual community. 
Until this dream is realized, we shall 


welcome hearing from the readers what 
they think is the feasibility and practi- 
cability of utilizing action research in 
psychotherapy, and of how such a pro- 
gram can best be put into effect. 
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SOME POSTULATES CONCERNING PSYCHOTHERAPY’ 
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TAFF meetings of clinical psychol- 
S ogists are very likely to follow a 
pattern which helps to throw consider- 
able light upon particular cases. Since 
attention is directed toward specific 
problems, it is by that very circum- 
stance directed away from general prin- 
ciples which are often, nevertheless, im- 
plicit in the discussions. Some aware- 
ness of this state of affairs suggests a 
methodology which is very simple but 
well suited to the scientific development 
of clinical knowledge. The methodology 
I have in mind consists of nothing more 
than our attempting to formulate cer- 
tain general postulates as to what works 
in counseling as we discuss cases or, if 
not formulating postulates, relating the 
problem under consideration to as- 
sumptions that we already have in 
mind. All of us are familiar with postu- 
lates we make about such things as re- 
lease, insight, the relationship between 
counselor and client, etc., but we prob- 
ably do not give as much explicit at- 
tention as we might to their relevance to 
particular cases. I suspect we also tend 
to rest content with getting results 
without trying to systematize our know]l- 
edge in respect to the procedures em- 
ployed to achieve the results. These re- 
flections have led to the following state- 
ment of assumptions which are, of 
course, tentative but do represent an at- 
tempt at systematization. 

Postulate I. The problems dealt with 


*Paper given to the counseling staff of the 
Department of Psychology, Purdue University, 
April 29, 1948. 


in psychotherapy are in the nature of 
behavior which has immediately re- 
warding consequences, but more remote 
punishing consequences. Mowrer and 
Ullman [3] are responsible for this con- 
cept of maladjustment. Its range of ap- 
plication is shown by the examples they 
use. An alcoholic escapes from im- 
mediate problems but incapacitates him- 
self for looking after his affairs. A child 
vents his resentment by enuresis but 
brings more retaliation upon his head. 
Additional examples come readily to 
mind. Conspicuous among them is with- 
drawal which relieves the individual for 
the moment but makes it harder and 
harder for him to cope with life. A less 
obvious example perhaps is an hysteri- 
cal muscle twitch based upon repression 
or concealment of tendencies experi- 
enced as shameful by the individual. 
Upon further examination, however, 
such a sympton can be conceived of as 
serving the purpose of an immediate 
outlet for energy but producing more 
remote fears of lack of control. The il- 
lustrations are taken at random, and 
would seem to attest to the applicability 
of this first postulate. Whether it will 
stand up in the light of scrutiny, how- 
ever, is not so important as the stimu- 
lation it might furnish to examine the 
kind of phenomena we deal with for the 
purpose of determining exactly how 
they can be described. 

Postulate II. Changes in maladjust- 
ive behavior require that cues to the 
nonrewarding or punishing conse 
quences of the behavior become avail- 
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able to the individual. The contiguity be- 
tween such cues and changes in behavior 
can be attested to by numerous ex- 
amples. Sensitivity in a marriage re- 
lationship results in defensiveness 
toward the marriage partner which in 
turn creates a strain in the relationship. 
When there is an awakening to this 
sensitivity, it becomes a cue to the non- 
rewarding consequences of the defens- 
ive behavior. A parent who gains an ap- 
preciation of his own inability to be af- 
fectionate thereby achieves a cue to the 
nonrewarding consequences of domi- 
nating his children. A child who can 
clearly experience hostility when he 
destroys a doll representing a parent 
has a cue to the punishing consequences 
of delinquent or antagonistic behavior. 
In the latter instance, the cue would 
probably not be verbalized; the child’s 
hostility would simply come into focus. 
This suggests a continuity between 
therapy involving verbal insight and 
other forms of therapy which seem to 
produce changes in behavior without 
much awareness on the part of either 
the therapist or the client as to what has 
taken place. It seems to me that cues of 
the kind that have been referred to are 
present in both cases. In some instances 
they are verbalized and in others they 
are not. This point of view is given fur- 
ther plausibility by a consideration of 
certain experiments with animals. 
Mowrer and Ullman [3] trained rats to 
come to a food trough when a bell was 
sounded. If they ate before a certain 
period had elapsed, they received a 
shock at the end of the period or short- 
ly thereafter. The animals could not 
solve this problem unless the bell con- 
tinued “‘to sound throughout the tabu 
period, thus providing our subjects with 
a cue which was sufficiently conspicuous 
to enable them to. make the necessary 
discrimination ..... ” (3, p. 77]. The 
continued sounding of the bell gave the 


animals a cue to the nonrewarding con- 
sequences of eating immediately. Al- 
though we know very little about the 
verbal processes of rats, it seems un- 
likely that they said anything to them- 
selves about the bell’s being a cue to the 
punishing results of too eager eating. 
It is quite possible that adjustive prob- 
lems are often solved in a similar 
fashion. When sensitivity, hostility, or 
other tendencies can be experienced, 
they perhaps serve as cues to the un- 
fortunate consequences of our behavior 
and enable us to solve our problems even 
though we do not explicitly recognize 
them as cues. 

It is of considerable interest to note 
that the client’s coming to grips with 
cues (which are usually conditions with- 
in himself) to the punishing conse- 
quences of his behavior is an emotional 
experience. In this connection, intel- 
lectual insight has often been dis- 
tinguished from emotional insight and 
the latter has been regarded as a reli- 
able indication of progress in psycho- 
therapy. A teacher might see abstract- 
ly, e.g., that his profession enables him 
to dominate others. An emotional 
awakening to the fact that a major 
satisfaction he gains from teaching is 
converting others to his point of view 
is another matter. At the same time he 
achieves a cue perhaps to the fact that 
his behavior has something to do with 
his son’s or daughter’s rebellious at- 
titude toward him. An understanding of 
the fact that the achievement of such 
a cue is an emotional experience has im- 
portant implications for therapy. Rog- 
ers [5] and his students have insisted 
that effective therapy must be an emo- 
tional rather than an intellectual experi- 
ence, and have directed their efforts 
toward the development of techniques 
facilitating the expression of feeling. 
We have probably all made some use of 
nondirective procedures even though we 
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might not call ourselves nondirective 
therapists. The difficulty that I, and I 
imagine others, have found is that re- 
flecting and clarifying feeling, sum- 
marizing what has been said, etc. are 
frequently insufficient. to, get the client 
rolling, so to speak. He has to feel com- 
fortable before he begins to talk and 
often seems to require some demonstra- 
tion of the fact that he is accepted. It 
might be added that when he does feel 
this acceptance, interpretation can be 
quite helpful and can even serve as fur- 
ther demonstration of acceptance and 
interest on the part of the therapist. 
This evaluation of interpretation seems 
to vary somewhat. from the nondirect- 
ive point of view, Differences of this 
kind can perhaps be scientifically re- 
solved through formulating and then 
testing in our actual counseling experi- 
ence the types of assumptions or general 
postulates set forth here. 

Postulate III. Cues to the nonreward- 
ing or punishing consequences of malad- 
justive behavior become available to the 
individual through a minimizing of his 
ego-involvement. Kubie has said that 
“every technical advance in psycho- 
therapy has been in the direction of 
finding ways around ., .. defensive 
barriers.” [2, p. 192] These defensive 
barriers usually, if not always, serve to 
protect the ego. A mother cannot readi- 
ly admit hostility toward her own child; 
a wife or husband cannot be sharply 
confronted with excessive dependence 
upon the marriage partner; an overly 
aggressive individual is not likely to ac- 
cept a blunt analysis of his actual fears 
of submission. In each instance it is like- 
ly that ego-involvement will ward off 
any calm consideration of the facts of 
the matter. This is certainly probable 
if the therapist engages in what Kubie 
calls “naive confrontation,” i.e., forcing 
a patient “to look at a painful fact about 
himself.” [2, p. 190] 


Thorne makes an observation that is 
particularly pertinent to this consider- 
ation of ego-involvement in psycho- 
therapy. “Almost all psychotherapy is 
to some degree disturbing to the patient 
because it is deflating to the ego to be 
so maladjusted that it becomes neces- 
sary to place one’s self in the embar- 
rassing position of having to admit 
failure and seek help from others.” 
[7, p. 463] An obvious implication is 
that an important part of therapy is 
establishing rapport. We al) know this, 
but we probably also frequently ignore 
it in our eagerness to get results. Learn- 
ing theory has taught us that knowledge 
of results facilitates progress, and it is, 
therefore, understandable why we 
should look for them. Perhaps some re- 
flection over the fact that gaining rap- 
port is in itself “a result” can temper 
impatience that interferes with the 
achievement of this very result. 

But how do we gain rapport and 
minimize ego-involvement? Kubie says 
that “One learns slowly never to force 
a patient to look at a painful fact about 
himself until you are in a position to ex- 
plain its origin in his history and its 
function in his present life.” [2, p. 190] 
Without taking issue with Kubie on the 
basis of one statement taken out of con- 
text, it might, nevertheless, be observed 
that an explanation of the origin and 
function of some personality trend may 
not be sufficient to avoid ego-involve- 
ment. An advantage that explaining the 
origin of a tendency has, it seems to me, 
is that it can be pointed out to a client 
with complete honesty that there are 
reasons for his problems. Mere knowl- 
edge of this fact does not, of course, 
solve the problems but if the therapist 
gives some stress to it without discount- 
ing the present existence of the prob- 
lems, the client may feel a greater meas- 
ure of acceptance. In brief, it is one 
thing to explain the origin and another 
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to explain it and at the same time point 
out that there are reasons for the prob- 
lem. This may sound like hair-splitting, 
but I suspect that more than one patient 
has not returned for subsequent inter- 
views because the former rather than 
the latter procedure has been followed. 
It might be added here that telling a 
client that anyone else with the same 
background would have the same type 
of problem, which can also be done quite 
honestly, may relieve ego-involvement 
considerably since strong feelings of in- 
adequacy are usually in the picture 
when a person presents himself for psy- 
chotherapy. 

Ego-involvement and self-acceptance 
might be conceptualized as the opposite 
ends of a continuum. Accordingly, any- 
thing which fosters self-acceptance pre- 
sumably minimizes ego-involvement. 
Furthermore, there are, I believe, cer- 
tain specific methods a therapist can use 
to enhance self-acceptance. A client’s 
expectations are often completely out of 
line with what is commensurate with his 
experience and a new perspective 
toward himself is gained when this is 
made clear. If, for example, he is humili- 
ated by his failure to converse brilliant- 
ly with individuals of broader experi- 
ence and education, it might be pointed 
out to him that he is “running in the 
wrong race,” as Wendell Johnson [1] 
has put it. Still another procedure that 
can promote self-acceptance is the 
direction of the individual’s attention to 
the fact that he may have been “sold a 
bill of goods” in respect to attitudes 
toward himself. A woman in our cul- 
ture, to say nothing of a man, picks up 
a positive evaluation of the facial and 
bodily characteristics of a Betty Grable. 
If a girl does not happen to possess 
these characteristics, she is likely to 
make a somewhat negative evaluation 
of herself. This may cause her to behave 
defensively toward men which will in 


turn incur considerably more rejection 
from males than her appearance. Some 
discussion of the fact that we learn to 
disrespect ourselves because of such cul- 
tural factors carries with it the sug- 
gestion that we don’t necessarily have 
to persist in it. Similarly, a man who 
has not only been taught in childhood 
that he can be President, but isn’t like- 
ly to be worth much if he doesn’t be- 
come President of the U. S., or, at least 
of his company, can be led into a con- 
sideration of values he has taken for 
granted but which are not necessarily 
eternal truths. The manner in which the 
therapist opens up this question is im- 
portant since people cannot simply be 
talked out of their values. If the spirit 
is one of indicating that a negative 
evaluation of ourselves does not have to 
be accepted, as it often is unconsciously 
without reflection over its basis, a client 
may feel more free to go ahead with 
facing himself. 

A final comment concerning the cli- 
ent’s ego-involvement has to do with 
how omniscent a role should be taken 
by the therapist. On the one hand the 
client has a need to regard him as an ex- 
pert, but on the other hand a “this is 
your problem” attitude may present a 
challenge to the client which does noth- 
ing to minimize his ego-involvement. 
Roger’s position seems to be that respect 
for the client means that the therapist 
refrains as completely as possible from 
interpretation. An alternative procedure 
is the setting up of hypotheses as to the 
causes of difficulties which client and 
therapist can evaluate and consider co- 
operatively. Such cooperativeness does 
not lend itself to the therapist’s taking 
an omniscent role, and at the same time 
may have the advantage of making it 
possible to demonstrate a sincere in- 
terest in the client’s problems without 
presuming to explain and direct his 
whole life. Whether the therapist should 











be even less directive is another question 
that can perhaps be better analyzed in 
the light of the types of postulates that 
have been proposed. 

Postulate IV. Changes in maladjust- 
ive behavior require active steps on the 
part of the client as well as the achieve- 
ment of cues to the punishing conse- 
quences of the behavior. Probably every 
therapist has witnessed what can aptly 
be described as shakiness when a client 
begins to get cues to the nonrewarding 
consequences of his behavior. Borrow- 
ing terms from Adler, we might say that 
the client is placed in the position of 
having one style of life taken away be- 
fore he has had opportunity to sub- 
stitute a new one. It can be argued that 
when therapy is effective the client will 
begin spontaneously to take active steps 
toward a new style of life. It sometimes 
appears, nevertheless, that the client is 
set to change but does not know quite 
how to go about it. I believe that the 
therapist can actively make suggestions 
at this point without fostering depend- 
ence or failing to respect the client’s 
capacity for handling his own life. Let’s 
cay, for example, that a client has a con- 
siderable amount of anxiety that he 
handles by withdrawal. The latter is 
threatened by the necessity of speaking 
in public and the anxiety is intensified. 
The therapist might suggest to the cli- 
ent that he shape up his speeches by 
considering what his major points will 
be, using these points as a framework, 
and then letting his talk be a matter of 
filling in this framework. This is in con- 
trast to a procedure he may have been 
following which involved writing out 
his speeches laboriously, memorizing 
them, and experiencing panic or near 
panic while giving the speeches lest he 
forget his lines. In an instance of this 
kind, the new procedure can be discus- 
sed from the point of view enabling the 
client to think on his feet, an idea to 
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which he will probably be receptive. It 
does not have to be imposed on him, and 
even if it is not followed, it can stimu- 
late thinking along the lines of ac- 
cepting difficult situations as challenges 
and figuring out how they might be 
handled. 


A suggestion of the kind that has just 
been discussed can do more harm than 
good if it is made prematurely. By pre- 
maturely, I mean prior to establishing 
rapport and minimizing ego-involve- 
ment as well as before some insight in- 
to his withdrawal (attainment of cues 
to its punishing consequences) has 
taken place. This brings to mind the 
most frequent mistake made by untrain- 
ed counselors who might tell a retiring 
person to get out and mix and thereby 
threaten his ego since he already feels 
inadequate about not being able to mix, 
to say nothing of the simultaneous fail- 
ure to enable him to achieve insight. If 
one final claim can be made for the 
virtue of setting up postulates, it might 
be suggested that, among other things, 
they can assist in the task of training 
counselors. 


Postulate V. Changes in maladjustive 
behavior emerge from a relationship be- 
tween counselor and client which is sup- 
portive in nature but which also fosters 
the client’s independence.? Aside from 
actual therapeutic experience, support 
for this postulate might be found in the 
fact that maladjusted individuals have 
not had this type of relationship in their 
early experience. They have, instead, 
been the victims of either excessive pro- 
tection or rejection. Having missed in 
their development a gradual weaning 
away from dependence, it would seem 
to follow that they would have to go 
through this kind of experience in order 
to “get well.” 


2 Professor Paul Alexander has suggested 
this last postulate as one meriting separate dis- 
cussion from the others. 
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Some of the major differences in 
therapeutic points of view are related 
to this postulate. Traditional psycho- 
analysis holds, if I understand it cor- 
rectly, that the dependence of the pa- 
tient has to become as complete as pos- 
sible before independence can be 
achieved. Rank [4] broke from the 
tradition by directing attention to the 
relationship aspects of therapy and en- 
couraging his patients “to make the 
break.” He also held that insight, or 
what here has been called getting cues 
to the nonrewarding consequences of 
behavior, had no real therapeutic effect. 
I disagree on this score because cues to 
the results of our behavior, it seems to 
me, may enable us to alter it in such 
a way that we achieve the types of re- 
lationships with others that Rank con- 
sidered so important. I agree with 
Rank, however, about the desirability of 
looking forward to terminating the 
counselor-client relationship as well as 
even raising the question after a cer- 
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tain time about such matters as con- 
tinuing regular appointments. I also 
lean toward the hypothesis that the cli- 
ent doesn’t really “get well’ until he 
goes forth and tries his own wings. 
Birds and children don’t grow up, at 
any rate, until they are out of the nest. 
Perhaps our clients don’t either. 
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CHARACTERISTICS OF A DESIRABLE ‘PSYCHOLOGI- 
CAL REPORT TO THE VOCATIONAL COUNSELOR 


By SALVATORE G. DIMICHAEL 


OFFICE OF VOCATIONAL REHABILITATION, FEDERAL SECURITY AGENCY 


PSYCHOLOGIST may do the best 
A kind of professional work with a 
client who is referred to him for voca- 
tional evaluation, but if the report of 
his findings is prepared ineffectively, it 
may be slighted by the vocational coun- 
selor. Moreover, its value for the client 
will largely be lost. A psychological re- 
port is the medium through which the 
requested professional services are 
made known to the counselor for his 
use. In certain respects, the work of 
preparing a psychological report is like 
the mission of a teacher. Both must 
“put the subject across” so that the pro- 
fessional contents are transmitted and 
the message understood. 

This paper was written after making 
a critical examination of approximately 
seventy reports submitted by psycholo- 
gists in different sections of the country 
to vocational counselors dealing with 
disabled civilians, under the Federal- 
State program of rehabilitation. No 
more than two reports in the collection 
were written by the same psychologist. 
Each report had some individuality of 
its own. Nevertheless, certain features 
of the better and poorer variety of re- 
ports became very apparent. 

The report of the psychologist will 
have to take into account not only the 
nature of the services but also the in- 
tended reader. Some reports were so 
erudite and technical, it seems probable 
that the counselor threw them aside in 
a feeling of hopelessness. In one in- 
stance, the counselor merely catalogued 
the psychologist as an “impractical the- 


orist” and did not bother to request a 
better explanation. Although the coun- 
selor was amiss in his responsibility, 
the psychologist must share the blame 
at least in equal part for being unaware 
of the reality of the situation. 


The psychologist should recognize the 
nature of his relationship with the coun- 
selor. The psychologist is a specialist- 
resource. He is not expected to size up 
the whole case from the vocational 
viewpoint and to propose a complete 
plan to the counselor. Rather should he 
regard his report as one which the coun- 
selor will use, together with those of 
other specialists, to obtain a complete 
picture of the client to help the indi- 
vidual plan his vocational life. The psy- 
chological report should furnish impor- 
tant and otherwise unavailable infor- 
mation on aptitudes, abilities, skills, 
achievements, interests, and personality 
patterns. It should emphasize the ob- 
jective measurements of the individual. 
It has the same status as reports made 
by other specialists such as the physi- 
cian, psychiatrist and social worker — 
each of whom offers only a partial pic- 
ture of the individual with respect to 
job choice, training, and employment. 
In civilian rehabilitation, no specialist 
is expected or should attempt to counsel 
the client vocationally. That function 
belongs to the vocational counselor. 

From the careful examination of the 
many different reports, it seems that a 
desirable psychological report should in- 
clude five general sections: 

1. Observations of the Client’s Be- 
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havior 

2. Technical Results 

8. Interpretation of Technical Re- 
sults 

4. Recommendations 

5. Summary 


Suggestions on the characteristics of 
a desirable psychological report to vo- 
cational counselors will be made in a 
discussion of each of these sections. 


Section 1. Observations on the Client’s 
Behavior 


This section should include important 
aspects of the client’s behavior before, 
during and after testing. The behavior 
should be described and interpretations 
made as far as the data permits. Spe- 
cial emphasis should be given to those 
aspects of the client’s behavior which 
indicate his work habits and personal- 
ity traits as these have significance in 
vocational adjustment. 

The observations of the psychologist 
furnish important data to the counselor. 
In the usual counseling situation, the 
client is made to feel that the atmos- 
phere is friendly, helpful, and nonde- 
manding. The client is under no pres- 
sure such as he would meet on the job. 
His reactions to the tests may furnish 
the psychologist and the counselor with 
excellent leads. The following descrip- 
tion of test behavior was contained in 
a report and illustrates our point: 


“The client seemed most cheerful and at ease 
when the tasks were well within his level. 
When the tests challenged him, the perform— 
ance began to disintegrate and he did not hesi- 
tate to vent his anger on the materials and 
twice upon the tester.” In another report, the 
following comment was included “ .... the 
client appeared long before the appointed time, 
dressed in fresh and neat clothes. He seems to 
be constantly trying to make a fine impression. 
This desire permeated his entire behavior dur- 
ing the testing. It may be the outcome of a 
well concealed anxiety, a conclusion which is 
also indicated by his frequent attempts to con- 


vince the examiner that his inadequacies on 
difficult problems were caused by temporary 
nervousness.” Favorable aspects of behavior 
also may be noted, as was done in this excerpt, 
“In conversations before the tests were admin- 
istered, the [blind] client said that he had not 
yet learned to use his cane and might need 
assistance in finding his way around. This re- 
mark was made quite casually and indicated 
a realistic attitude toward the problem of deal- 
ing with his newly acquired handicap.” 


This section of the report allows the 
psychologist a great deal of freedom in 
recording his observations. It is up to 
him to sift the important from the triv- 
ial things seen, and to enrich the ob- 
servations by intelligent interpreta- 
tions. 


Technical Results 


The test results should be presented 
in a brief, technical manner. They 
should be shown in clear, graphic form 
whenever possible, listing the name of 
each test, the normative group, raw 
score, percentile and psychograph. The 
question may be raised about the pro- 
priety of presenting test results in such 
technical form. It may be claimed that 
they may easily be mispresented. These 
objections seem valid when reports are 
to be made for an audience of laymen 
but it does not seem correct for coun- 
selors. Among the latter will be found 
a sufficient number who have had cours- 
es in psychometrics, and who appreci- 
ate the problems of test interpretation. 
These counselors will be able, when nec- 
essary, to reinterpret the results in the 
context of new vocational plans which 
were previously unforeseen. 

From experience in dealing with 
counselors, it appears best to present 
the test scores in percentiles because 


Section 2. 


i1Further ideas on this phase of the psycho- 
logical evaluation may be obtained from Bing- 
ham [1], pages 229-235, where an adaptation 
of a checklist by F. Baumgarten is presented 
for use in noting and interpreting test be 
havior. 








they are much better understood than 
any other forms of equated scores. Al- 
though standard scores are more desir- 
able scientifically, they are understood 
by fewer counselors. Almost all the ex- 
amined psychological reports used per- 
centile scores. Only a few used a psy- 
chograph but the latter have a distinct 
appeal to counselors. In some of the re- 
ports, the normative group was not de- 
scribed with each test score. This is 
most unfortunate because of the diffi- 
culty of accurate interpretation, and the 
use of the scores in re-evaluating the 
client in the context of new plans. 


Section 3. Interpretation of Test Re- 
sults 


This section is intended to present in 
narrative form an interpretation of the 
test scores in nontechnical language. 
The writeup seems to be superior when 
it explains all information on test re- 
sults in such a way that no reference is 
needed to the previous part. 

Essentially, this section should be a 
running description of test perform- 
ance. It should include an account of 
the abilities measured by each test, the 
score, normative group, and the meaning 
of the performance as it relates to the 
measured abilities and the norms. The 
explanation is most impressive and 
readable when presented in narrative 
style such as would do credit to any im- 
portant business report. Cryptic stac- 
cato sentences appeared in one report 
as “....in business part scored in 80th 
percentile, under which clerical was at 
75th, shipping at 60th... .” This ex- 
planation can hardly be highly regard- 
ed, nor can it be unravelled except per- 
haps by other persons who use the same 
style. 

The interpretation at this point 
should consider each test, one at a time, 
or a few tests closely related in terms of 
the abilities measured, such as two man- 
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ual measurements, or two interest in- 
ventories. The interrelation of the 
scores and other data should be left to 
the next section of the report. In other 
words, this section is the place for limit- 
ed generalizations on the individual’s 
pattern of abilities. Thus, one paper ex- 
plained the results on the Wechsler- 
Bellevue in this way: “. .. . analysis 
shows that on the Bellevue verbal sub- 
tests, only comprehension falls below 
average. This indicates poor judgment 
and makes it seem advisable not to place 
the client in a position of responsibili- 
ty.” 

This section of the report may also be used 
to describe the behavior exhibited during the 
particular test and to relate it to the test re- 
sults. Thus, “....on the Minnesota Rate of 
Manipulation, he revealed himself to be an ex- 
tremely fast and accurate worker. He showed 
a well integrated performance both in the 
Turning and Displacing tests. Work was done 
with a minimum of tension and he demon- 
strated an easy orientation to the work re- 
sponsibility involved.” One paper carried this 
information: “During the oral administration 
of the adjustment inventory, it came out that 
the client was much ashamed of his father who 
was a gambler. A.B. said he was a man of 
high ideals and he resents the fact that his 
father deals in lotteries and bets on horse 
races.” 

This section most frequently presented 
a picture of the abilities, interests, and 
personality patterns of the individual in 
terms of their present level of function- 
ing. This quality is in contrast to the 
recommended content of the next section 
in which a dynamic picture of the in- 
dividual is given. This manner of high- 
lighting the individual as he is now, may 
be termed the “single-snapshot” picture. 
This is important to the counselor who 
must work with the client as he now 
finds him. The person may change in the 
future but the steps to be taken depend 
upon the more complete understanding 
of his physical, mental, family, social, 
educational, vocational and other phases 
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of life. 


Unusual! facts, as these pertain to particu- 
lar tests, may also be narrated. Thus, one re- 
port read: “It was thought that the Bellevue 
scale might throw some light on the deteriora- 
tive process but the results were inconclusive. 
Certainly O. was inferior in speed of response 
and ability to understand directly and perceive 
relations, but the perception of spatial configu- 
rations which breaks down in organic cases 
was her best performance.” 


Two practices should be avoided. One 
is to make specific job recommendations 
after describing single test scores. The 
net result, after one reads the entire re- 
port, is confusion and contradiction be- 
cause of the uneven level of aptitudes, 
abilities, interests, etc. An individual 
may be intelligent enough to do work on 
a skilled occupational level, but his in- 
terests may be on a professional level, 
and his educational achievement may be 
very low. Another undesirable practice 
is to report verbatim the suggestions 
presented in the test manual on test in- 
terpretation and vocational objectives. 
Seldom does such stereotyped reporting 
fit the individual case. 


Section 4. Recommendations 


In the examined reports, this section 
seemed to give the best indication of the 
depth of knowledge, good judgment, or- 
ganized thinking and professional status 
of the psychologist. There seems to be 
no easy pattern which the psychologist 
may follow in developing his recom- 
mendations. Since each client is an in- 
dividual and different from others, this 
section must reflect that fact. The value 
of this section of the report will be in 
proportion to the ability of the psychol- 
ogist to make an accurate synthesis of 
the individual on the basis of all the 
facts at his disposal. 


This section highlights the interrelationship 
of the data. Different examples may be offered 
to show how this was stated by different re- 


porters. In one paper, the motivational pat- 
tern was related to the test scores as follows: 
“He has a strong desire to succeed. This was 
brought out during the short interview and the 
test situations. We feel that he will succeed 
in any of the occupations in which he professes 
interest, in spite of mediocre abilities.” In an- 
other report, the psychological results were 
explained upon a background of medical infor- 
mation as follows: “The retardation of intel- 
lectual function is apparent in psychometric 
examination, but the organic pathological con- 
dition is not stationary judging from the clini- 
cal picture, with apparent improvement in to- 
tal function since the control of the convulsions 
by dilantin. Therefore, the prognosis must be 
flexible as the patient must be given further 
opportunity to improve under the best condi- 
tion of medical, social, and vocational therapy.” 
In another instance, the psychologist made a 
suggestion to the counselor about the difficul- 
ties which the client might encounter in his 
vocational adjustment because of the apparent 
deep-seated nature of the personality traits 
manifested during the testing: “.... he might 
change to some sort of office job although he 
will be at first unhappy in doing anything 
which will not sufficiently bolster his ego.” 


Another characteristic of good report- 
ing is the explicit interpretation of the 
relative importance of the accumulated 
data. All the better reports manifested 
the psychologist’s critica] ability to 
show how certain things were more or 
less important than others. An illustra- 
tion of this characteristic is found in 
this excerpt: “His high aptitude in the 
clerical field is not reinforced by suf- 
ficient motivation to indicate that this 
area should be given any except a sup- 
porting role in his placement planning.” 

In contrast to the “snapshot” picture 
of section 3, this part of the report 
should strive to present a dynamic ac- 
count of the developing individual. This 
is another characteristic which seemed 
to differentiate most sharply between 
the reports of poorer and better quality. 
A dynamic representation of the devel- 
opment of the total personality usually 
refers to the possible future adjust- 
ments of the individual. In one example 
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of this characteristic, the psychologist 
wrote as follows: “In view of the long 
standing pattern of moderate neurotic 
anxiety and the limited exposure of the 
individual to stimulating experiences 
during his long period of hospitali- 
zation, his present interests may change 
considerably after work tryouts in a re- 
habilitation conditioning center.” 

In all the reports, suggestions were 
made about suitable or unsuitable oc- 
cupations for the client on the basis of 
the psychological evaluation. Experience 
has shown that this part of the report 
prompts the most controversy among 
vocational counselors. Some counselors 
claim to find the occupational recom- 
mendations most helpful while others 
reject them as inadequate and inac- 
curate. In this connection, it may be well 
to mention the fact that there is a dis- 
tinction between analyzing the individu- 
al and analyzing the job. In order to re- 
late the knowledge of the individual ac- 
curately to the world of occupations, it 
is necessary to know the one and the 
other, and to make a correct integration 
of the information. The usual training 
of most psychologists has prepared 
them to analyze the individual, but their 
knowledge of the realities of occupa- 
tions is deficient. In many instances, 
their understanding of the complete de- 
mands of the job has to be picked up by 
incidental experience. 


After a vocational rehabilitation 
counselor has been on the job for a peri- 
od of one or two years, he usually ac- 
quires a considerable amount of in- 
formation about occupational demands 
and requirements, future trends, and 
current opportunities. As a result, his 
knowledge outstrips that of the psychol- 
ogist unless the latter has the same type 
of experience. For this reason it is bet- 
ter to refrain from making categorical 
recommendations on occupational ob- 
jectives. One supervisor who had tried 
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out a psychological center by referring 
a few of his clients wrote us this com- 
ment on the reports: “In our opinion 
their suggestions on occupations are too 
directive and their interpretation in 
terms of job objectives shows a limited 
knowledge of the actual job require- 
ments, especially when it is considered 
in the light of a client who has work 
limitations.” 


Most psychologists meet this problem, with- 
out incurring the criticism of the counselors, 
by making guarded suggestions. Thus, the 
suggestions in one report were prefaced by this 
statement: “Certain tentative suggestions are 
being made on the basis only of the specific 
results presented in this report.” In another 
paper, very specific jobs were suggested in this 
manner: “It is possible that beauty work or 
simple dressmaking might be advisable, or 
other vocation on a similar occupational level 
which includes some artistic features.” It is 
advisable as a usual practice to recommend oc- 
cupational areas and job families rather than 
specific jobs, frequently using specific jobs as 
illustrations, and occasionally as more definite 
objectives. 


In most cases, the process of vocation- 
al counseling develops into a number of 
possible alternative plans. Rarely does 
the case show that the client should fol- 
low one set course and no other. The 
psychological report should reflect this 
common trait of vocationa] counseling. 
Under the section on Recommendations, 
it would be well to outline two or more 
possible avenues which the client may 
follow and the chances of success in 
each. Thus, the psychologist may in- 
dicate that if the client could undertake 
long-time training, certain fields of 
work are advisable. If the client must 
seek immediate employment, other fields 
of work are more satisfactory. Perhaps, 
training and employment can be taken 
concurrently. 


Section 5. Summary 


The summary should highlight the 
main features of the psychological eval- 
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uation. It should attempt to present the 
gist of the previous sections shorn of 
the less important matters. Many ex- 
amined reports left out this section; a 
few drew up a summary in a paragraph 
or two; a few made a short list of the 
assets and limitations of the individual. 
Most reports did not include recom- 
mendations on specific jobs in the Sum- 
mary. The emphasis was on the abilities, 
aptitudes, skills, achievements, interests 
and personality of the client. 

This section should answer very brief- 
ly the specific questions which were 
raised by the counselor in referring the 
client for psychological evaluation. One 
report noted in the summary that: “A. 
B. may go into clerical work if it is of a 
lower order of difficulty and if the de- 
mands for speed are not great. The vo- 


cational objective of stenography, which 
we particularly sought to evaluate for 
the client in accordance with your re- 
quest, hardly appeared suitable accord- 
ing to the test results.” 

In this paper, we have attempted to 
point out the importance of devoting 
careful attention to the preparation of 
a psychological report. The report, we 
believe, should reflect the calibre of 
services rendered and should also be 
framed in terms of the understanding 
and needs of the counselor who referred 
the client. The report should be clear, 
concise, informative, and as business- 
like as would do credit to the profession- 
al services rendered. 
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Burtt, HAaRotp E. Applied psychology. New 
York: Prentice-Hall, 1948. Pp. x + 821. 
$7.35. 


Applied psychology is a textbook for stu- 
dents who have completed an introductory 
course, and a reference book for lay readers 
interested in the practical aspects of the sci- 
ence. Four fields of application are covered ex- 
tensively: to education, to medicine, to law, 
crime and testimony, and to employment, in- 
dustry and business. A final chapter gives 
brief recognition to some other areas, includ- 
ing art, music, recreation, public opinion, 
politics, war and peace. On the whole, the ap- 
plications “to medicine” are less well handled 
than are the other sections. Research is less 
frequently cited and is less well selected for 
pertinence, Psychotherapy is so eclectically 
treated that suggestion, psychoanalysis (mea- 
gerly described), reasoning-out, and nondirect- 
ive counseling seem to share the author’s en- 
dorsement equally. One feels that an opportuni- 
ty has been lost to present the personally use- 
ful applications of mental hygiene — the as- 
pects significant to the reader’s own life, The 
areas of application other than clinical do not 
show corresponding faults. Research findings 
are richly represented and well integrated, and 
the writing is gracious and lucid. 


DENNIS, WAYNE (Ed.) Readings in the history 
of psychology. New York: Appleton-Centu- 
ry-Crofts, 1948. Pp. xi + 587. $4.75. 


The history of psychology is illustrated by 
sixty-one selections of original writings, rang- 
ing from Aristotle (ca. 300 B. C.) to Hull 
(1930). Thirteen date from before 1800, thirty 
are ninteenth century writings, and eighteen 
are from the present century. Browsing 
through these mileposts of our past gives a 
decided impression of the historical unity of 
clinical psychology and “pure” psychology. Not 
only are clinical psychologists interested in 
Braid on hypnotism (1846), Preyer on the child 
(1882) and Cattell on mental tests (1890), but 
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they find equally basic to their practice the 
writings of James (1884) and Cannon (1914) 
on emotion, and of Franz and Lashley (1917, 
1929) on brain and behavior. The Readings 
will find an important place in the training of 
all psychology students, whether “pure” or ap- 
plied. 


FRIEND, JEANNETTE G. AND HAGGARD, ERNEST 
A. Work adjustment in relation to family 
background. Appl. Psychol. Monogr. No. 16. 
Stanford, Calif.: Stanford Univ. Press, 1948. 
Pp. 150. $2.00. 


Eighty clients of the Vocational Counseling 
Service of Boston, referred by social agencies 
between 1934 and 1943, were the subjects of a 
long-term follow-up study. Each was rated on 
173 items covering early life, mature or cur- 
rent family life, early or beginning jobs, re- 
sponse to counseling, personality patterns, re- 
actions to work conditions, and general work 
adjustment and achievement. The factors were 
compared to vocational success and adjustment 
as criteria. This study concludes ..... “For 
people, it seems, are able to endure the actual 
hardships of illness and poverty, the pressures 
from the outside, more easily than the inner 
emotional pressures — rejection and acute in- 
trafamily antagonisms and self-doubt.” 


KLUCKHOHN, CLYDE AND MURRAY, HENRY A. 
(Eds.) Personality: in nature, society and 
culture. New York: Knopf, 1948. Pp. xxi 
+ 561. $4.50 (text edition). 


This anthology gives further evidence of the 
growing interest of all of the social and biologi- 
cal sciences in the problems of personality. It 
is a collection of papers by forty-one “anthro- 
pologists, biologists, psychiatrists and sociolo- 
gists” (the jacket does not mention psychol- 
ogists although several are represented), con- 
sisting mainly of reprints of articles originally 
published in journals. Integration superior to 
that of most books of readings is achieved by 
the editors’ own first two chapters, and by their 
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able introductions to each section. The contents 
comprise a conception of the nature of person- 
ality; constitutional, social and situational 
determinants of personality; and applications 
to a number of specific problems. Since most 
of the selections are taken from sources out- 
side of the primary field of psychology, psy- 
chologists and their students will find much in 
the volume that is stimulating and informative. 


Lipo, Lester M. Attitude prediction in labor 
relations — a test of “understanding.” Stan- 
ford, Calif.: Stanford Univ., Graduate 
School of Business, Division of Industrial 
Relations, 1948. Pp. ii + 17. $1.00 


A research report of an attitude study on 
24 labor-management issues. A management 
group and a labor-leader group each indicated 
their own attitudes and the predicted attitudes 
of the other group. The two groups’ own at- 
titudes were antagonistic on 22 of the 24 is- 
sues. The management group failed to predict 
labor’s attitude on 3 items, and labor missed 
management’s attitudes on 10 items. 


MACKINNON, DONALD W. AND HENLE, MARY. 
Experimental studies in psychodynamics. 
Cambridge, Mass.: Harvard Univ. Press, 
1948. Laboratory Manual, Pp. ix + 177, and 
experimental material, 212 sheets, $5.00. In- 
structor’s Manual, Pp. 45. 


It is generally agreed that students of clini- 
cal and social psychology should have a good 
background in experimental psychology, but 
the kind of experimental psychology is usually 
unspecified. Too often, alas, the experimental 
training of clinical psychologists consists of the 
repetition of classic exercises in sensation, psy- 
chophysics and learning, that may have a re- 
mote relationship to dynamic problems (or so 
some professors rationalize), but whose perti- 
nence and application are not apparent to the 
student. MacKinnon and Henle make a clean 
break with tradition in providing a series of 
fourteen experiments dealing with concepts 
that include the recall of finished and un- 
finished tasks, ego-involvement, satiation, level 
of aspiration, conflict, repression, frustration, 
aggression and regression. In the manuals and 
accompanying multigraphed sheets that pro- 
vide almost all materials needed for the ex- 
periments, the authors display many ingenious 
(and slightly fiendish) ways to annoy and 
frustrate the subjects of the experiments. One 
drawback of the method is that the students 
must persuade appreciable numbers of their 


psychologically naive friends to serve as sub- 
jects — few of the experiments can be per- 
formed on psychology students themselves. 
There can be some doubt concerning the validi- 
ty of experiments that require students to 
select “extrapunitive”’ or “introverted” sub- 
jects, without specific objective criteria to 
identify such persons. Even so, this laboratory 
course in psychodynamics represents a notable 
accomplishment. 


O’CONNOR, WILLIAM A. Psychiatry. Baltimore: 
Williams & Wilkins, 1948. Pp. 380. $x.xx. 


This brief practical treatise by an eminent 
British psychiatrist is eclectic in viewpoint, 
with some leanings toward psychoanalysis. The 
organization is conventional, with the usual 
sequence of chapters on the symptoms and the 
syndromes. The style, however, is exceptional- 
ly clear and lively, and the author succeeds 
well in conveying his solid understandings to 
the reader. 


TESTS 


How Supervise? by Quentin W. File and H. 
H. Remmers. Supervisors in industry. 3 
forms. Untimed, (25) min. Test blanks, 
Forms A and B, 1943, and Form M, 1948 
($1.75 per 25) ; Scoring keys; Manual, pp. 8, 
revised, 1948. Psychological Corporation, 
New York, N. Y., 1943, 1948. 


How Supervise? is a test of knowledge and 
insight concerning human relations in in- 
dustry. The original alternate Forms A and B 
have been available since 1943; the new Form 
M contains the items from A and B that have 
proved most discriminating at higher super- 
visory levels, and is recommended for use with 
office or top level supervisors. Reliability is 
reported as .87; validity data are discussed in 
terms of the differentiation of levels of super- 
visors, of scores before and after supervisory 
training, and of managers’ ratings of super- 
visors. The test may be used for the selection 
and placement of supervisory employees, or as 
a basis for the discussion of principles of 
supervision. 


Lincoln Adaptation of the Oseretsky Test, by 
William Sloan. Ages 4-16. Individual test. 1 
form. Revised manual, pp. iv + 68. Author, 
Lincoln State School and Colony, Lincoln, 
Ill., 1948. 


The previously available manual for the 








Oseretsky Tests, translated from the Portu- 
guese, is insufficiently specific in some aspects 
of the directions for administration and scor- 
ing (see J. consult, Psychol., 1947, 11, 157). 
The Lincoln adaptation presents the tests with- 
out any major revisions, but with definite 
directions in the American tradition, including 
exact words for the examiner to say, and 
quantitative standards for scoring. No norma- 
tive data are yet available on an American 
population, and the test is still regarded as in 
a preliminary stage of development. 


V. D. L. Adult Psychomotor Test series, for 
the measurement of manual ability, by M. J. 
A. Van Der Lugt. Ages 16-adult. Individual 
test. 1 form. Mainly untimed, (30) min. 
Testing equipment ($48.00), Paper materials 
($2.50 per 25), Manual, pp. 61 ($1.75). 
Author, Department of Psychology, New 
York Univ., Washington Square, New York 
3, N. Y., 1948. 


The Van Der Lugt psychomotor series con- 
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sists of ten subtests, entitled speed prehension, 
speed asynkinesia, pressure reproduction, pres- 
sure control, accuracy-steadiness, accuracy-pre- 
cision, motor memory-direction, motor memory- 
spatial, coordination-static, and coordination- 
dynamic. All are administered by means of a 
kit consisting of some 25 parts, some of which 
are interchangeably assembled for use in more 
than one subtest. The tasks, which have con- 
siderable originality, were selected from among 
many tried out through years of experi- 
mentation. Percentile norms for each subtest 
are based on over 500 adults. The retest re- 
liability of each subtest is reported as .90 or 
higher. Validities for various purposes are 
still under investigation, but promising 7’s 
from .51 to .73 are reported between the test 
and ratings of industrial employees’ efficiency. 
The scale holds promise for use in guidance 
and in vocational selection, and for the quanti- 
fication of the performances of handicapped 
persons. A children’s form was standardized 
in Europe, and is now in process of revision. 
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INDEX TO VOLUME XII 


SUBJECT INDEX 


Adjustment, prediction of, 174 

Allergies, psychotherapy for, 111 

Altus adjustment test, 276 

Army, AWOL/’s, screening of, 276 
information test, 270 

Art ability, McAdory test, 280 

Artistic interest, and language handicap, 240 

Audio aids in group therapy, 313 


Bernreuter personality inventory, situational 
variations, 255 

Book reviews, 59, 123, 196, 282, 361, 438 

Buck time appreciation test, 187 


Child, personality appraisal, 16 
Clinical psychology, orientation for, 221 
Coding, of MMPI profiles, 343 
Color shock, Rorschach, 360 
Contingency technique, in therapy, 116 
Counseling, nondirective, development of, 92 
self-reference in, 153 
situation as obstacle, 217 
symposium on, 65 
interview methods, 321 
o Psychotherapy 
Counselor, vocational, report to, 432 
CVS test, clinical possibilities, 171 
standardization, 355 
validity, 48 


vocational, 


Séeé Cis 


Deception, effect on MMPI, 396 

Delinquents, intelligence of, 58 

Deficit, psychological, Hunt-Minnesota test, 53 
Shipley-Hartford Retreat Test, 259, 265 
Wechsler-Bellevue test, 259, 265 

Deterioration, mental, see Deficit 

Diagnosis, psychiatric, and MMPI, 251, 331, 
337 
and psychotherapy, 120 

Diagnostic testing, round table on, 1 

Digits test, placement of Wechsler-Bellevue, 
345 

Empathy, and insight, 228 

Ethnic groups, measurement of intelligence in, 
194 


Food aversions in behavior disorders, 310 


Group psychotherapy, see Psychotherapy 


Hunt-Minnesota test for organic brain dam- 
age, 53 


Impairment, mental, see Deficit 
Incomplete sentences test, history of, 190 
Information test, abbreviated, validity of, 270 
Insight, and empathy, 228 
and prediction of behavior, 174 
Intelligence, delinquents, 58 
measurement in ethnic groups, 194 
see also Test 
Interest, artistic, and language handicap, 240 
Kuder preference record, 240 
methods, 


Interview in vocational 


99 
4 


counseling, 


Kent EGY test, 187 
K scale, MMPI, 20, 251, 331, 337 
Kuder preference record, 240 
Language handicap, and artistic interest, 240 
McAdory art test, modification, 280 
Memory for designs test, standardization of, 
349 
Mental defectives, prediction of adjustment by 
Rorschach, 303 
Minnesota Multiphasic Personality Inventory, 
coding profiles, 343 
deception on, 396 
diagnostic efficiency of, 251, 331, 337 
and experimental semistarvation, 403 
item analysis of, in semistarvation, 403 
K scale, 20, 251, 331, 337 
and Rorschach, 375, 379, 384 
subtle and obvious keys, 164 
Motor proficiency test, Oseretsky, 37 


Neurotic scores, Bernreuter, situational varia- 
tions, 255 
Nondirective counseling, see Counseling 


Obvious keys for MMPI, 164 
Oseretsky test, annotated bibliography, 37 


Personality, appraisal of child, 16 
inventory, Altus 36-point, 276 
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Bernreuter, 255 
see also Minnesota Multiphasic Personal- 
ity Inventory 
rating, from role playing, 234 
test, food aversions, 310 
validation design for studies of, 365 
Phenomenological concepts in therapy, 197 
Play therapy, 209 
Profiles, coding of MMPI, 343 
Projective technique, in group testing, 8 
proverbs, 246 
quantification of, 14 
sentence completions, 190 
see also Rorschach and Thematic Appercep- 
tion Test 
Proverbs, projective method, 246 
Psychiatry, and clinical psychology, 221 
Psychotherapist, self-experience of, 82 
Psychotherapy, allergic patients, 111 
contingency technique, 116 
and diagnosis, 120 
goals, methods, and tactics, 68 
group, allergies, 111 
audio aids, 313 
nondirective, client evaluation, 137 
control for group Muench’s subjects, 412 
development of, 92 
obstacles to, 217 
phenomenological concepts in, 197 
play, 209 
postulates, 426 
relationship in dynamics of cure, 76 
self-experience of therapist in, 82 
social field in, 417 
symposium on, 65 
see also Counseling 


Relationship, therapeutic, 76 
Role-playing, ratings from, 234 
Rorschach, color and shading shock, 360 
color responses and MMPI, 384 
group, methods, 8 
and MMPI, 375, 379, 384 
research method, 300 
movement responses, 379 
prediction of adjustment of defectives, 303 
research techniques, 300, 365 
validation design for, 365 


Schizophrenia, frequencies of TAT themes, 387 
scale of MMPI, and group Rorschach, 375 
Wechsler-Bellevue patterns, 32, 127 

Screening test, Army AWOL’s, 276 
of intelligence, 187 

Self-concept, and behavior prediction, 174 
in counseling, 153, 197 

Sentence completions test, history of, 190 


Shading shock, Rorschach, 360 
Shipley-Hartford Retreat test, 259, 265 
Social aggressiveness, ratings of, from role 
playing, 234 
field in psychotherapy, 417 
Starvation, experimental, and MMPI, 403 
Stanford Achievement Test 187 
Stanford-Binet Test, qualitative interpretation, 
16 
Students, college, frequency of TAT themes, 
387 
Subjective interpretation, of TAT, 285 
Subtle keys for MMPI, 164 


Test, abbreviated intelligence, clinical possi- 
bilities, 171 
standardization, 355 
validity, 48 
Buck, time appreciation, 187 
CVS, clinical use, 171 
standardization, 355 
validity, 48 
deficit, 53, 259, 265 
Hunt-Minnesota, 53 
information, abbreviated, 270 
Kent EGY, 187 
McAdory art, 280 
memory for designs, 349 
motor proficiency, 37 
Oseretsky, bibliography, 37 
screening, 187 
sentence completions, 190 
Shipley-Hartford Retreat, 259-265 
Stanford Achievement, 187 
Stanford-Binet, qualitative interpretation, 
16 
type of, in relation to intelligence, 194 
Wechsler-Bellevue, deficit measure, 259, 265 
placement of digits, 345 
schizophrenic patterns, 32, 127 
short forms, 48, 147, 171, 355 
Testing, diagnostic round table on, 1 
objective and subjective aspects, 4 
projective methods, 8 
Tests, reviews of new, 62, 126, 284, 439 
Thematic Apperception Test, and empathy, 228 
frequencies of themes and identifications, 387 
and subjective interpretation, 285 
Therapy, see Psychotherapy and Counseling 
Vocational counseling, interview methods, 321 
counselor, report to, 432 


Wechsler-Bellevue Test, deficit measure, 259, 
265 
digits, placement of, 345 
schizophrenic patterns, 32, 127 
short forms, 48, 147, 171, 355 
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New Books in Psychology 


THE EMOTIONSS Outline of A Theory 
By JEAN-PAUL SARTRE 


N this small volume, the eminent French philosopuer develops a new theory of psychological 
interpretation. Delving into the “magic” of the emotional process, he analyzes the roles which 


fear, lust, melancholy and anguish play in the life of man, and what is the true reality of con- 
scious life. 


Sartre’s new book is a significant step on the way to the understanding of the emotions. $2.75 


THE PSYCHOLOGY OF IMAGINATION 
By JEAN-PAUL SARTRE 
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evidence of this preeminence.” ev. 
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By PHILIP L. HARRIMAN 
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out the various aspects o 

the science with the assistance of numerous 

collaborators well known in the field. 
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LANGUAGE 

By RICHARD A. WILSON 


Deep and ori thinking about the func- 
tions of in the life of man. So im- 
pressed was George Bernard Shaw by “the 
magnitude of the service the author has 


PSYCHIATRY FOR EVERYMAN 
By J. A. C. BROWN 

An introduction to psychiatry 
practical iafevioation for the 
“Sound, reliable and well balanced. 
State Jrnl. of Med. 


SELECTED WRITINGS OF 
BENJAMIN RUSH 


Contains thousands of entries covering all | 24ited by DAGOBERT D. RUNES 


basic terms and concepts in psy- 
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OUTSTANDING McGRAW-HILL BOOKS 


By STANLEY G. LAW, M.D, 
Minnesota Psychiatric Institute 
McGraw-Hill Series in Health Science 
$13 pages, 54 X 8. $4.50 
In this book Dr. Law presents many practical treatment guides for several of the more com- 
mon psyc:.oneurotic entities perennially encountered medical practice. Intended for the phy- 
sician who finds a need for psychotherapy in dealing with his emotionally disturbed patients, 
the book is limited to interview techniques, illustrating the handling of emotional difficulties by 
the dialogue method using everyday nontechnical! languag: 


COMMONSENSE PSYCHIATRY 
OF DR. ADOLF MEYER 


Fifty-two Selected Papers 
Edited, with Biographical Narrative 
by ALFRED LIEF 





677 pages, 6 X 9. $6.50. De luxe edition, $14.00 
McGraw-Hill Series in Health Seience 


The basic writings of a physician who helped to sha; e course of American psychiatry, and 
whose first-hand teaching is now presented for the time in book form. Working closely 


with Dr, Meyer, the editor has assembled his addre urnal articles, and reports, and linked 
them together with an account of the author’s life and work which points up the evolution of 
his thought. The book traces the development of th: nmonsense approach to the problems of 
psychiatry which deals with the whole organism in relation to daily life. 


THEORY AND PROBLEMS OF 
SOCIAL PSYCHOLOGY 


By DAVID KRECH 
University of California 
and RICHARD S. CRUTCHFIELD 
Swarthmore College 
McGraw-Hill Publications in Psychology 
622 pages, $4 

This basic text is the first modern work of its kin: develop an integrated and consistent 
approach to the science of psychology as a system interpretative account of social behav- 
ior. A large part of the book is devoted to the basic principles of human behavior, which are 
then “spelled out” in their operation im such behavior as racial prejudice, labor-management 
conflict, propaganda, group morale, leadership, international tensions, ete. 





Send for copies 


McGRAW - HILL BOOK COMPANY, Inc. 


330 West 42nd Street New York 18, N.Y. 





